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Abstract. We undertake a local analysis of combinatorial independence as it connects to 
topological entropy within the framework of actions of sofic groups. 



1. Introduction 

Among the various phenomena in dynamics associated with randomness, weak mixing and 
entropy stand out for the depth of their theory and the breadth of their applications (see for 
example [13 . flij). In the setting of discrete acting groups, weak mixing makes sense in general 
while entropy, as classically formulated, requires the group to be amenable. One can view these 
two concepts in a unified way across both measurable and topological dynamics by means of the 
combinatorial notion of independence. In close parallel with the l\ theorems of Rosenthal and 
Elton-Pajor in Banach space theory, weak mixing and positive entropy reflect two of the basic 
regimes in which combinatorial independence can occur across the orbit of a tuple of sets in a 
dynamical system. The first of these asks for independence over a subset of the group having 
infinite cardinality, while the other requires this subset to satisfy a positive density condition. 



Inspired by work in the local theory of entropy 181, the authors studied this connection between 
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independence, weak mixing, and entropy in [23j, [2j] as part of a program to develop a general 
theory of combinatorial independence in dynamics. 

Combinatorial independence is the basic set-theoretic expression of randomness in which we 
are concerned not with the size of intersections, as in the probabilistic context, but merely 
with their nonemptiness. A collection {(Ai i, . . . , A% k)}ieJ °f ^-tuples of subsets of a set X 
is independent if for every nonempty finite set F C J and function uj : F — > {1, . . . ,k} the 
intersection HieF ^.£,u>(i) is nonempty. If a group G is acting on X then given a tuple (Ai, . . . , Ak) 
of subsets of X we say that a set J C G is an independence set for (A±, . . . , A^) if the collection 
{{s~ l A\, . . . , s Ak)} se j is independent. In the case of an action of a countable amenable group 
G on a compact Hausdorff space X, the independence density 1(A) of a tuple A = (A%, . . . , A^j 
of subsets of X is defined as the limit of ifA(F)/\F\ as the nonempty finite set F C G becomes 
more and more left invariant, where ipj±(F) denotes the maximum of the cardinalities of the 
independence sets for A which are contained in F [231 . Prop. 3.23]. We then say that a tuple 
(x%, . . . , Xk) G X k is an IE-tuple if for every product neighbourhood U\ X • • • x Uk of (x\, . . . , x^) 
the tuple U = (U\,...,Uk) satisfies I(U) > 0. This condition on U is equivalent to the 
existence of an independence set J C G for U which has positive density with respect to a 
given tempered F0lner sequence {Fj}j g N in the sense that lim^oo \F{ n Jl/li^l > 0. It turns out 
that a nondiagonal tuple is an IE-tuple if and only if it is an entropy tuple 0, Sect. 3]. For 
general acting G we define IT-tuples in the same way as IE-tuples except that we ask instead 
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for the independence set to have infinite cardinality. Versions of IE-tuples and IT-tuples can 
also be defined for probability-measure-preserving actions by requiring the condition on the 
independence set to hold whenever we remove small parts of the sets sU\, . . . ,sllk for each 
s G G. The following are some of the results relating independence, weak mixing, and entropy 
that were established in 23|, 24 ] . 



(1) A continuous action G r\ X of an Abelian group on a compact Hausdorff space is 
(topologically) weakly mixing if and only if every tuple of points in X is an IT-tuple (in 
which case the action is said to be uniformly untame of all orders). 

(2) A probability-measure-preserving action G r\ (X, fi) of an arbitrary group is weakly 
mixing if and only if its universal topological model is uniformly untame of all orders. 

(3) A continuous action G r\ X of a discrete amenable group on a compact Hausdorff space 
has positive topological entropy if and only if it has a nondiagonal IE-pair (for G = Z this 
was first proved by Huang and Ye in 20] using measure-theoretic techniques). Moreover, 
the action has uniformly positive entropy if and only if every pair of points in X is an 
IE-pair, and uniformly positive entropy of all orders if and only if every tuple of points 
in X is an IE-tuple. 

(4) A probability-measure-preserving action G rx (X, [/,) of a discrete amenable group has 
positive measure entropy if and only if there is a nondiagonal measure IE-pair in some 
topological model. Moreover, the action has complete positive entropy if and only if 
every tuple of points is an IE-tuple in the universal topological model (for G = Z this 
was proved by Glasner and Weiss in [HI]). 

Chung and the second author applied IE-tuples in 0] as part of a new approach for studying the 
relation between homoclinicity and entropy in expansive algebraic actions that enabled them 
to break the commutativity barrier and establish some duality-type equivalences for polycyclic- 
by-finite acting groups. In this case, and more generally for actions of a countable amenable 
group on a compact group X by automorphisms, the analysis of IE-tuples is governed by a single 
closed invariant normal subgroup of X called the IE group 0, Sect. 7]. 

Recent seminal work of Bowen in [H has expanded the scope of the classical theory of entropy 
for actions of discrete amenable groups to the much broader realm of sofic acting groups. For 
a countable group G, soficity can be expressed as the existence of a sequence £ = {o~i : G —> 
Sym(dj)} of maps from G into finite permutation groups which is asymptotically multiplicative 
and free in the sense that 
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{k G {1, . . . , di} : <x i>B t(k) = <Xi >3 <Xi t(k)} 



(i) lim — 

i— >oo di 

(ii) lim — {k e {1,... ,di} : a it8 (k) / o- u {k)} 



1 for all s,t G G, and 
1 for all distinct s,t G G. 



>oo di 

Such a sequence for which lirnj_ J . 00 d j = oo we call a sofic approximation sequence. By measuring 
the asymptotic exponential growth of dynamical models which are compatible with a fixed sofic 
approximation sequence, Bowen defined in 0] a collection of invariants for probability-measure- 
preserving actions of a countable sofic group admitting a generating partition with finite Shannon 
entropy. A remarkable application of this sofic measure entropy was a far-reaching extension of 
the Ornstein- Weiss classification of Bernoulli actions of amenable groups. 

The authors developed in (25| a more general operator-algebraic approach to sofic entropy 
that enables one to remove the generator hypothesis (see also [22j for a formulation in terms 
of finite partitions). This led to a sofic version of topological entropy as well as a variational 
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principle relating it to sofic measure entropy. We used this variational principle to compute the 

sofic topological entropy of a principal algebraic action G rx ZG/ZGf of a countable residually 
finite group in the case that the sofic approximation sequence arises from finite quotients of G 
and / is invertible in the full group C*-algebra C*(G). In line with previous work on algebraic 
actions 0, 0, [H, [13] (see also the more recent (HJ), this value turns out to be equal to the 
logarithm of the Fuglede-Kadison determinant of / in the group von Neumann algebra LG. We 
also showed how topological entropy can be used to give a proof that Gottschalk's surjunctivity 
conjecture holds for countable sofic groups, a result originally established by Gromov in [13], 




where the idea of soficity itself first appeared. 

In the present work we initiate a local analysis of independence as it connects to topological 
entropy within this broadened framework of actions of sofic groups. Given a continuous action 
G rx X of a countable sofic group and a sofic approximation sequence E = {a-i : G — > Sym(dj)} 
for G, we define the notion of a E-IE-tuple by externalizing the positive independence den- 
sity condition in the amenable case to the finite sets {1, . . . ,di} appearing in the sequence E 
(Definition I4.3p . We show in Section |4] that E-IE-tuples share many of the same properties as 
IE-tuples for actions of discrete amenable groups. In particular, the action G rx X has positive 
entropy with respect to E if and only if there is a nondiagonal E-IE-pair in X x X. On the other 
hand, we do not know whether the product formula holds in general for E-IE-tuples. However, 
granted that we use a free ultrafilter 5 over N to express the independence density condition in 
the definition of E-IE-tuples, we demonstrate in Theorem 15.21 that the product formula holds 
under the assumption of ergodicity on the action of the commutant of G inside the group of 
measure-preserving automorphisms of the Loeb space ]^[^{ 1 , . . . ,di} which arise from permuta- 
tions of the sets {1, ... ,di}. We then prove that this commutant acts ergodically when G is 
residually finite and E is built from finite quotients of G (Theorem I5.T|) , and also when G is 
amenable and E is arbitrary (Theorem 15 ,8p . In the case that G is nonamenable, a combination 
of results of Elek and Szabo [l3|, Thm. 2] and Paunescu [36l ] shows that there exist E for which 
the ergodicity condition fails. 

The definition of IE-tuples for amenable G, as given in (23[, involves an asymptotic density 
condition over finite subsets of G which become more and more invariant. Although density in 
this sense loses its meaning in the nonamenable case, we might nevertheless ask what the external 
independence density in the definition of E-IE-tuples implies about the degree of independent 
behaviour across orbits in X. We observe in Proposition 14.61 that every E-IE-tuple (and more 
generally every sofic IE-tuple as defined in Definition 14. 3p is an orbit IE-tuple, by which we 
mean that for every product neighbourhood U\ x • • • x Uk of the given tuple (x±, . . . ,Xk) in 
X k , the tuple (U\, . . . , Uk) has positive independence density over G in the sense that there is 
a q > such that every finite set F C G has a subset of cardinality at least q\F\ which is an 
independence set for (C/j, . . . , Uk) (note that this definition makes sense for any acting group 
G). We show moreover in Theorem 14.81 that, for amenable G, E-IE-tuples, IE-tuples, and orbit 
IE-tuples are all the same thing. This puts us in the pleasant and somewhat surprising situation 
that IE-tuples can be identified by a density condition that does not structurally depend on 
amenability for its formulation, and raises the question about the relation between entropy and 
orbit IE-tuples for nonamenable sofic G. In another direction, Theorem 17. 1 1 asserts that if a tuple 
of subsets of X has positive independence density over G then it has an infinite independence 
set in G, which implies that every orbit IE-tuple is an IT-tuple. 
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By a theorem of Chung and the second author in [8|] , an algebraic action of a countable group 

G is expansive if and only if it is either the dual action G r\ Xa '■= (7LG) n j (7LG) n A for some 
n G N and matrix A G M ra (ZG) which is invertible in M n (£ 1 (G)), or the restriction of such an 
action to a closed G- invariant subgroup of Xa- In the same paper it is shown that an expansive 
algebraic action G r\ X of a polycyclic-by-finite group has completely positive entropy with 
respect to the Haar measure prescisely when the IE group is equal to X, which is equivalent to 
every tuple of points in X being an IE-tuple. It is also shown that, when G is amenable, every 
action of the form G rx Xa with A invertible in M n (£ 1 (G)) has the property that every tuple 
of points in X is an IE-tuple (see Lemma 5.4 and Theorems 7.3 and 7.8 in |8|]). We prove in 
Theorem 16.71 that if G is a countable sofic group, n G N, and A is a matrix in M n (ZG) which is 
invertible in M n (£ (G)), then the algebraic action G r\ Xa has the property that every tuple of 
points in Xa is a S-IE-tuple for every sofic approximation sequence S. We use this to answer 
a question of Deninger in the case that G is residually finite by combining it with an argument 



from [8] and the entropy computation for principal algebraic actions from 25] mentioned above 
to deduce that if / is an element of ZG which is invertible in and has no left inverse in 

ZG then the Fuglede-Kadison determinant of / satisfies det^c/ > 1 (Corollary I6.8p . Deninger 
asked whether this holds for all countable groups [13, Question 26] , and affirmative answers were 



given in ll|] for residually finite amenable G and more generally in [8] for amenable G. 

For a continuous action G r\ X of a countable group on a compact metrizable space with 
compatible metric p, we say that a pair (x,y) G X x X is a Li-Yorke pair if 

limsup p(sx, sy) > and liminf p(sx, sy) = 0, 

where the limit supremum and limit infimum mean the limits of sup sgG \^ p(sx, sy) and 
inf seG \ F p(sx, sy), respectively, over the net of finite subsets F of G. Note that the defini- 
tion of Li-Yorke pair does not depend on the choice of the metric p. The action G r\ X is said 
to be Li-Yorke chaotic if there is an uncountable subset Z of X such that every nondiagonal 



pair (x,y) in Z x Z is a Li-Yorke pair. The notion of Li-Yorke chaos stems from [301 ] . In the 
case of a continuous map T : X — > X, a theorem Blanchard, Glasner, Kolyada, and Maass in 
0] states that positive entropy implies Li-Yorke chaos. In [23[ the authors strengthened this 
by showing that for every k > 2 and product neighbourhood XJ\ X • • • X Uk of a nondiagonal 
IE-tuple (xi, . . . ,Xk) G X k there are Cantor sets Z$ C Ui for i = 1, . . . , k such that 

(1) every nonempty tuple of points in (Jj is an IE-tuple, and 

(2) for all m G N, distinct yi, . . . , y m G |Jj Z{, and y[, . . . , y' m G (Jj Zj one has 

liminf max p(T n yj,'»') = 0. 

In Theorem 18. II we show that a similar result holds when G is sofic and IE-tuples are replaced by 
S-IE-tuples as defined with respect to a free ultrafilter J on N, where S is any sofic approximation 
sequence for G. Using $ in the definition of entropy, we deduce that if the action has positive 
entropy for some S then it is Li-Yorke chaotic. 

The following diagram illustrates how some of the main results of the paper relate various 
properties of actions of a countable discrete group G on a compact metrizable space X, which 
we assume to have more than one point. In the left column we assume that G is sofic and that S 
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is a fixed but arbitrary sofic approximation sequence. The unlabeled implications are trivial. By 
pair we mean an element of X x X. See [23] for terminology related to tameness and nullness. 



uniformly positive 
entropy w.r.t. E 



m 

l4~6l every pair ED uniformly untame 
every pair — y . J — y , . 

- >■ ' (every pair 



is a E-IE pair 

H2H3) 

positive entropy 
w.r.t. E 

1313) 



is an 
orbit IE-pair 



3 nondiag. 
E-IE-pair 



1531 



Li-Yorke 
chaotic 



. 3 nondiag. : 
orbit IE-pair 



FT2l 



is an IT-pair) 

6.4(2) in f2l 

untame 

6.4(2) in [H 



j> 3 nondiag. 
IT-pair 



uniformly nonnull 
(every pair 
is an IN-pair) 

5.4(2) in l2l 

nonnull 

5.4(2) in [H 



^ 3 nondiag. 
IN-pair 



The organization of the paper is as follows. In Section [2] we set up some basic notation and 
review sofic topological entropy. In Section we introduce orbit IE-tuples and prove a product 
formula for them. Section E] introduces S-IE-tuples and includes our results relating them to 
orbit IE-tuples. In Section [5] we focus on the product formula for S-IE-tuples and the question 
of ergodicity for the action of G' on the Loeb space. Section [6] contains the material on algebraic 
actions. In Section [7] we prove that positive independence density for a tuple of subsets implies 
the existence of an infinite independence set, showing that orbit IE-tuples are IT-tuples. Finally 
in Section [8] we establish the theorem connecting independence and entropy to Li-Yorke chaos 
in the sofic framework. 

Acknowledgements. The first author was partially supported by NSF grants DMS-0900938 and 
DMS-1162309. The second author was partially supported by NSF grant DMS-1001625. We 
are grateful to Wen Huang and Xiangdong Ye for helpful comments. 



2. Sofic topological entropy 



We review here the definition of sofic topological entropy [251 . l26j ] and in the process introduce 
some of the basic notation and terminology appearing throu gho ut the paper. Our approach will 
bypass the operator algebra technology that appears in 2a, |26[ . 

Let Y be a set equipped with a pseudometric p and let e > 0. A set A C Y is said to be (p, e)- 
separated if p(x,y) > £ for all distinct x,y G A. Write N £ (Y,p) for the maximum cardinality of 
a (p, e)-separated subset of Y. 

Let G rx X be a continuous action of a countable sofic group on a compact metrizable space. 
Let X = {(Tj : G — > Sym(cZj)} be a sofic approximation sequence for G, meaning that 
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(i) lim — {k G {1, . . . ,di} : a iySt {k) = a iyS a iy t(k)} 



co di 
(ii) lim — 

i— >oo dj 



{k G {1, . . . , di} : a i s (k) / (?i,t(k)} 



1 for all s,t G G, 
1 for all distinct s,t £ G, 



and dj — >• oo as i — > oo. Depending on the situation, for a G {1, . . . , di} we may write <7j iS (a), 
(Ti(s)a, or sa to denote the image of a under the evaluation of Oj at s. 

Let /? be a continuous pseudometric on X. For a given d G N, we define on the set of all maps 
from {1, . . . , d} to X the pseudometrics 

P 2(^) = (- d Y.{p{^{a)Ma)))^ 112 

\ a=l 

Poo(<P,i>) = max p(cp(a),ip(a)). 

a=l,...,d 

Definition 2.1. Let F be a nonempty finite subset of G and (5 > 0. Let a be a map from G to 
Sym(d) for some d G N. Define Map(p, F, J, er) to be the set of all maps (p : {1, . . . , d} — > X such 
that p2(<p<7 s , Oi s <p) < 5 for all s G F, where a s is the transformation x \— > sx of X. 

Definition 2.2. Let F be a nonempty finite subset of G and 5 > 0. For e > define 
h%2(p> F ,S) = limsup — log N e (Map(p,F, 5, ai),p 2 ), 

i— >oo 

/ l | )2 (p,F) = inf^| i2 (p ! F,«5), 

o>U 

^, 2 (p)=mf/ i £ E, 2 (p,F), 

^E,2(P) = SUp/l E2 (p), 

£>0 

where F in the third line ranges over the nonempty finite subsets of G. In the case that 
Map(p, F, S, Gi) is empty for all sufficiently large i, we set h^ 2 (p,F,5) = — oo. We similarly 
define h% )O0 (p,F,8), h^ )O0 {p,F), h^ jOQ (p) and h^ )00 (p) using N e (-,poo) in place of N s (-,p 2 ). 

Instead of the limit supremum above we could have taken a limit over a fixed free ultrafilter 
on N, whose utility is apparent for example if we wish to have a product formula (see Section [5|). 
We will also use this variant in Section [HI 

The pseudometric p is said to be dynamically generating if for every pair of distinct points 
x, y G X there is an s G G such that p(sx, sy) > 0. 

Lemma 2.3. Suppose that p and p' are continuous pseudometrics on X and that p' is dynami- 
cally generating. Let F be a nonempty finite subset of G and 5 > 0. Then there exist a nonempty 
finite subset F' of G and 6' > such that for any d G N and sufficiently good sofic approximation 
a :G ->■ Sym(d) one has Map(p', F', 5', a) C Map(p, F, <5, cr). 

Proof. List the elements of G as si,S2, • • • • Since p' is dynamically generating, we have the 
compatible metric p" on X defined by 

oo 

p"(x,y) = ^kP'(s k x,s k y). 
fc=i z 

It follows that there are a nonempty finite subset F" of G and a 5" > such that, for all 
x, y G X, if max seF // //(sx, sy) < 6" then y) < 5/2. Set F' = F" U (F"F). Let 5' > and 
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let a be a map from G to Sym(d) for some d G N. Let tp G Map(p', F' ,5' ,a). Then 
|{a € {1, . . . , d} : p 1 ' (s\s 2 tp(a) ,(p((sis 2 )a)) < V& and 

p'(snp(s 2 a),Lp(si(s 2 a))) < \f8' for all si G F",s 2 G F}| 
> (l-2|F"||F|<S')d. 

Suppose that 2\/8' < 5" and a is a good enough sofic approximation for G so that 
\{a G {1,...,4 : (s lS2 )a = Sl (s 2 a) for all si G F",s 2 G F}| > (1 - 

Then 

\{a G {1, . . . ,d} : p(s<p(a) , <p(sa)) < 5/2 for all s G F}| 

> \{a G {1, ... ,d} : p'(s 1 s 2 Lf(a),snp(s 2 a)) < 2^/J' for all s x G F",s 2 G F}\ 

> (1 - (1 + 2|F"||F|)5')ci 

It follows that when 5' is small enough independently of d and a, one has <p G Map(p, F, 5, ex). □ 

The following proposition is contained in Proposition 2.4 of [26], whose statement and proof 
use the operator-algebraic formulation of sofic topological entropy from (25[. 

Proposition 2.4. Let p and p' be continuous pseudometrics on X which are dynamically gen- 
erating. Then 

hs,2(p) = hs }2 (p') = hs,oo(p) = hz )O0 (p'). 

Proof. Since the pseudometric p^ dominates the pseudometric p 2 , we have hs ;2 (p) < hz i00 (p). 

Next we argue that hs ;00 (p) < hs ;2 (p)- Let F be a finite subset of G, 5 > 0, and a a map 
from G to Sym(d) for some d G N. Let 1/2 > e > 0. Let n > be the minimum of e 2 and the 
reciprocal of the minimum cardinality of an (e/2)-spanning subset of X with respect to p. Given 
a ip G Map(p, F, 5, a), every element in the open (p2,??)-ball in Map (p, F, (5, a) around (p agrees 
with ip to within ^/rj, and hence to within e, on a subset of {1, ...,<i} of cardinality at least 
(1 — rj)d. Thus the maximum cardinality of a (poo> e)-separated subset of the open (p2,77)-ball 
around <p is at most X^'^o (j) 7 ?""'' wmcn by Stirling's approximation is bounded above, for all d 
sufficiently large, by e^ d rj~ rid for some ft > not depending on d with /3 — ?■ as e — >• 0. Hence 
A r £ (Map(p, F, 5, a), poo) < e? d rj^ d N v (M a p(p, F,5,a),p 2 ). 

It follows that 

h%oo(p) < h\ 2 {p) + P ~ V^ogv, 
and since ft — 77 log 7/ — > as e — > we conclude that /is,oo(p) < ^E,2(p)- 

Finally we show that /is,2(p) < ^£,2(p'); which will establish the proposition as we can 
interchange the roles of p and p'. 

Let e > 0. Since p is dynamically generating, we can find a finite set K C G and an 
e' > such that, for all x,y G X, if p(sx,sy) < V3p for all s G if then p'(x,y) < e/\/2. 
By shrinking e' if necessary we may assume that 3e'|F^| < e 2 /2. Take a finite set F C G 
containing iT and a <5 > with 6 < e' such that /if; 2 (p, F, 5) < /i| 2 (p) + e. Since p' is 
dynamically generating, by Lemma 12.31 there are a nonempty finite set F' Q G and a 5' > 
such that for any d G N and sufficiently good sofic approximation cr : G — >■ Sym(ci) we have 
Map(p', F', 5', a) C Map(p, F, 5, a). 
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Given tp,tp G Map(p', F' , 5' , cr) such that /^(v, < e '> f° r each seKwe have, writing a s for 
the transformation x i— > sx of X, 

p2(a s (p,a s i(j) < p2(a s ip,ipa s ) + p2((pa s ,ifja s ) + p2(ipcr s ,a s ip) < 5 + e' + 5 < 3e' . 

This implies that there is a set W C {1, . . . , d} of cardinality at least (1 — Se'ji^Dd such that for 
all a G we have p(sip(a), sip(a)) < \f^e' for every s G K and hence p'(ip(a),ifj(a)) < e/^/2. 
As a consequence, assuming (as we may by normalizing) that X has //-diameter at most one, 

P2M) < \l(e/V2f + 3e'\K\ < e. 

It follows that 

N £ (M a p(p',F',5',a),p2) < N £ ,(M a p(P,F,5,a),p2) 
and hence /if. 2 {p', F', 5') < 2 {Pi F, d~), so that 

h% 2 {p') < h%2(p',F',5') < h^ 2 (p,F,5) < h^ 2 (p) + e < h s , 2 (p) + e. 

Since e was an arbitrary positive number we conclude that hs t2 (p') < h^^(p)- D 

Definition 2.5. The topological entropy hs(X,G) of the action G rx X with respect to £ is 
defined to be the common value in Proposition 12.41 over all dynamically generating continuous 
pseudometrics on X. 

Note that the approximate multiplicativity of a sofic approximation was only needed in the 
proof of Lemma 12.31 to handle the situation in which one of p and p' is not an actual metric. 
Indeed we could have defined topological entropy more easily by using the obvious fact that 
^s,oo(p) takes a common value over all compatible metrics on X, with Proposition 12.41 then 
being regarded as a Kolmogorov-Sinai theorem. As with the (n, e)-separated set definition of 
topological entropy for single transformations, it is by considering pseudometrics that we can 
compute the entropy for a nontrivial example like the shift action G rx {1, . . . , k} G . In this case 
one can see that the value is log k independently of S by considering the pseudometric p on 
{1, . . . , k} G given by p(x, y) = or 1 depending on whether or not the coordinates of x and y at 
e agree. Indeed log k is easily seen to be an upper bound, and given a nonempty finite set F C G, 
a 5 > 0, and a good enough sofic approximation a : G — > Sym(ti) we can construct a (poo, 1/2)- 
separated subset of Map(p, F, 5, a) of cardinality k d by associating to every uj G {1, . . . , k} d some 
(p u G Map(p, F, S, a) defined by (p UJ (a)(s~ 1 ) = uj(a s (a)) for all a G {1, ...,d} and s G G. 

For actions of amenable G, the entropy hz(X,G) coincides with the classical topological 
entropy for every E [25(. Such an action always has a largest zero-entropy factor (i.e., a zero- 
entropy factor such that every zero-entropy factor factors through it), called the topological 
Pinsker factor 0]. More generally for sofic G, with respect to a fixed £ there exists a largest 
factor of the action G rx X which has entropy either or —00 (note that the value —00 does not 
occur for actions of amenable G) . This follows from the fact that the property of having entropy 
or —00 is preserved under taking countable products and restricting to closed invariant sets. 
We say that the action has completely positive entropy with respect to E if each of its nontrivial 
factors has positive entropy with respect to E. 

Unlike in the amenable case, the largest factor with entropy or —00 might have factors with 
positive entropy. In fact for every nonamenable G there exist zero-entropy actions of G which 
have factors with positive entropy: Take an action G rx X with hs(X,G) > and an action 
G rx Y which has no G-invariant Borel probability measure, and consider the action of G on 
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K := {X x Y) \[{z} where z is a point on which G acts trivially. Then h-z(K, G) = but the 
quotient action on XT]{z} satisfies hj;(X ]J{z} , G) > 0. 

3. Orbit IE-tuples 

Let G rv X be a continuous action of a discrete group on a compact Hausdorff space. Recall 
from the introduction that if A = (Ai, . . . , A k ) is a tuple of subsets of X then we say that a 
subset F of G is an independence set for A if for every finite subset J of F and every function 
u : J {1, . . . , k} we have UseJ s -1 / 0- 

Definition 3.1. Let A = (Ax, . . . , A k ) be a tuple of subsets of X. We define the independence 
density of A ( over G) to be the largest o > such that every finite set F C G has a subset of 
cardinality at least q\F\ which is an independence set for A. 

Definition 3.2. We say that a tuple x = (x\, . . . , x k ) G X k is an orbit IE-tuple (or orbit IE-pair 
in the case k = 2) if for every product neighbourhood f/i X • • • x U k of a; the tuple (U±, . . . , [/&) 
has positive independence density. Write IEk(X, G) for the set of all orbit IE-tuples of length k. 

As Theorem 14.81 below demonstrates, the notation IE k (X,G) is consistent with its use in f23(| 
when G is amenable. 

The equality in the next theorem statement is understood with respect to the identification 
of ((xx,...,x k ),(yx,...,y k )) G X k x Y k and ((a?i,yi),.. .,(x k ,y k )) G {X x 

Theorem 3.3. -Let Gr\I and G r\ Y be continuous actions on compact Hausdorff spaces. 
Let ken. Then 

IE fe (X x Y, G) = IE fc (X, G) x IE fe (y, G). 

Proof. The inclusion IE fc (X x Y,G) C IE fc (X,G) x IE fc (y,G) is trivial. To prove the other 
direction, it suffices to show that if A = (Ai , . . . , A k ) is a tuple of subsets of X with independence 
density q and B = (£>i, . . . , B k ) is a tuple of subsets of Y with independence density r, then 
A x B := {A\ x . . . , A k x B k ) has independence density at least qr. Let F be a nonempty 
finite subset of G. Then we can find a JCF with \J\ > q\F\ which is an independence set for 
A. We can then find a J\ C J with | J\\ >r\J\ which as an independence set for B. Then J% is 
an independence set for A x B and | J\\ > qr\F\. □ 

In [13] we defined a tuple x = (x\ , . . . , x k ) G X k to be an IN-tuple if for every product 
neighbourhood U\ x • • • x U k of x the tuple (Ui, . . . , C/^) has arbitrarily large finite independence 
sets. The following fact is obvious. 

Proposition 3.4. Suppose that G is infinite. Then every orbit IE-tuple is an IN-tuple. 
We will strengthen this assertion in Theorem 17.11 

4. S-IE-tuples 

Unless otherwise stated, throughout this section G is a countable sofic discrete group, subject 
to further hypotheses as appropriate. We suppose G to be acting continuously on a compact 
metrizable space X, and p denotes a dynamically generating continuous pseudometric on X 
unless otherwise stated. 
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In order to be able to define the notion of a sofic IE-tuple as appears in Proposition 14.61 we 
will set up our definitions for a general sofic approximation net £ = {o~i : G — > Sym(di)}, which 
is formally defined in the same way as the sequential version. 

Definition 4.1. Let A = (A%, . . . , Ak) be a tuple of subsets of X. Let F be a nonempty finite 
subset of G and 5 > 0. Let a be a map from G to Sym(d) for some d G N. We say that a set 
d C {1, . . . , d} is a (p,F,5, a) -independence set for A if for every function oj : # — > {1, . . . , k} 
there exists a 93 6 Map(p, F, 5, cr) such that </?(a) G Aj(a) f° r every a £ 3- 

Definition 4.2. Let A = (Ai, . . . , A&) be a tuple of subsets of X. Let S = {cr^ : G — > Sym(dj)} 
be a sofic approximation net for G. We say that A has positive upper independence density over 
£ if there exists a g > such that for every nonempty finite set F C G and 5 > there is a 
cofinal set of i for which A has a (p, F, 5, ^-independence set of cardinality at least qdi. By 
Lemma 12.31 this definition does not depend on the choice of p. 

For the purposes of Sections [5] and we will consider a variation of the above definition in 
which cofinality is replaced by the stronger requirement of membership in a fixed free ultrafilter 
J on N. The resulting notion of positive upper independence density over £ with respect to $ 
will then be used when interpreting the following definition of S-IE-tuples. 

By the universal sofic approximation net for G we mean the net (cr, F) 1— )■ a indexed by the 
directed set of pairs (cr, F) where cr is a map from G to Sym(d) for some d G N and F is a 
finite subset of G, and {a' : G — > Sym(d'), F') >- (a : G — ^ Sym(d),F) means that d' > d and 
\V(a',F)\/d' > \V(a,F)\/d, where V(w,F) for a map u : G -> Sym(c) denotes the set of all 
a G {1, . . . , c} such that cr(s)cr(t)a = o~{st)a for all s,t £ F and cr(s)a 7^ o~(t)a for all distinct 

s,teF. 

Definition 4.3. Let S = {crj : G — >• Sym(dj)} be a sofic approximation net for G. We say that a 
tuple x = (cci, . . . , Xfc) G X fc is a Y,-IE-tuple (or Tt-IE-pair in the case = 2) if for every product 
neighbourhood U\ x • • • x of x the tuple (JJ\, . . . , f/^) has positive upper independence density 
over S. We say that x is a sq/ic IE-tuple (or so^c IE-pair in the case fc = 2) if it is a S-IE-tuple 
for the universal sofic approximation net S. We denote the E-IE-tuples of length k by LE^ (X, G) 
and the sofic IE-tuples of length k by IE| of (X, G). 

Note that IE%(X,G) C IE| of (X,G) for every sofic approximation net E. 

We define E-IE-tuples and sofic IE-tuples of sets in the same way as for points above. 



Remark 4.4. It follows from Lemma 3.3 of 23J] that a nondiagonal tuple of points in X is a 



E-IE-tuple if and only if it is a S-entropy tuple in the sense of Section 5 in [401 ] . In particular, if 
in analogy with the amenable case we define the action to have uniformly positive entropy with 
respect to S when every nondiagonal pair in X x X is a E-entropy pair, then the action has this 
property precisely when every pair in X x X is a S-IE-pair. 

We will need the following consequence of Karpovsky and Milman's generalization of the 



Sauer-Shelah lemma [2ll. 1371. l39l|. 



Lemma 4.5 ([2l|]). Given k > 2 and A > 1 there is a constant c > such that, for all n G N, 
if S C {1,2,..., jfc}{lA~.,n} sa ti s fi es |£| > ((jfe _ l)A)« f/ien there is an I C {1,2, ... , n} mf/i 
|7| > cn and 5|/ = {1, 2, . . . , k} 1 . 

Proposition 4.6. ^4 sofic IE-tuple is an orbit IE-tuple. 
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Proof. Fix a compatible metric p on X. Let x = (x%, . . . , Xk) be a S-IE-tuple and U\ X • • • X U\~ a 
product neighborhood of a:. We will show that the tuple (Z7i , . . . , Uf.) has positive independence 
density over G. 

Suppose first that k > 1. Take 1 < A < r^. Then we have the constant c > in Lemma 14.51 

Let V\ x • • • x Vk be a product neighborhood of a? such that for some n > the K-neighborhood 
of Vj- is contained in Uj for all 1 < j < k. Then there exists a q > such that for every nonempty 
finite subset F of G and (5 > there is a cofinal set of i for which the tuple (V\, . . . , Vk) has a 
(p, F, 5, (jj)-independence set 3i of cardinality at least qdi. 

Let F be a nonempty finite subset of G. We will show F has a subset of cardinality at least 
(cq/2)\F\ which is an independence set for the tuple (Ui, . . . , £/&). Let 5 be a small positive 
number to be determined in a moment. 

Take an i in the above cofinal set with | Wj| > (1 — 5)d for Wj := {a G {1, . . . , dj} : F -> 
ai(F)a is injective}. For each cj : 0j — >• {1, . . . , k}, take a tp u g Map(p, F, <5, a) such that <p w (a) G 
K;(a) f° r an ° £ 3i- Then |{o G {1, . . . , Jj} : p(s(p L0 (a),(p UJ (sa)) < d~ 1 ^ 2 }\ > (1 — <5)J for each 
sEF and hence |A W | > (1 - |F|£)dj for 

A w := {a G {1, . . . , J} : p(s(p u (a), <£ w (sa)) < 5 1/2 for all s G F}. 
Set n = |F|. When n8 < 1/2, the number of subsets of {1, . . . ,d} of cardinality no greater 
than n5d is equal to 5^}=o Cj) » which is a t most ^5d( n ^ rf ) , which by Stirling's approximation is 
less than exp(/?d) for some /? > depending on 5 and n but not on d when d is sufficiently large 
with f3 — > as 5 — > for a fixed n. Thus when 5 is small enough and i is large enough, there is 
a subset S7j of {1, . . . , k}^ with ( ^-i)\ ) q — such that the set A w is the same, say 0j, 
for every uj G Oj, and |0j|/J > 1 — \F\5. Then 

i„,i > M^my d - > wfSLim* 1 _ ^-da^. 



k J ~ \ k 

By our choice of c, we can find a subset £[■ of 3% with > c\3i\ > cqdi such that every 
£ : — ^ {1, • • • , k} extends to some to G Oj. 

Writing £ for the uniform probability measure on {1, . . . , d}, we have 



/ ^ ( sa ) = E / M (*o dew 

^ E (¥ - (1*1 + > («? - (i*i + win 

and hence £ seF h'( sa i) > ( c <? ~ (1^1 + i) 5 )!^! for some a, G Wj n 0j. Then | J| > (cq - (\F\ + 
1)6)\F\ for Ji := {s G F : saj G 

We claim that Jj is an independence set for the tuple (U\, . . . , £/&) when (5 < k 2 . Let / G 

{1, ... ,k} Ji . Since a, G Wj, the map Jj l -4 1 <7j(Jj)aj is bijective. Thus we can define £' G 
{1,... by ^'(soj) = /(s) for s G Jj. Extend f to some £ G Then we 

can extend £ to some uj G f2j. For every s G Jj, since saj G 0j and a% G 0j = A w , we have 
¥>u(sa>i) £ K;(soi) = ^/(s) anc i p( sc Pu( a i)7 ( Pu( sa i)) — ^ X ^ 2 < K - By the choice of k we have 
s<fu(ai) G ?J/(a). This proves our claim. 

Taking 5 to be small enough, we have | Jj| > (cq — (|F| + 1)<5)|F| > (cq/2)\F\ as desired. 
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The case k = 1 can be established by a simpler version of the above argument that considers 
only a single map of the form (p^ and does not require the invocation of the constant c from 
Lemma 14.51 and the associated use of Stirling's approximation. □ 

For the remainder of this subsection, S = {<7j : G — > Sym(dj)} is a fixed but arbitrary sofic 
approximation sequence. 

In the case that G is amenable, the independence density 1(A) of a tuple A of subsets of X 



was defined on page 887 of [23|] as the limit of <pa(F)/\F\ as the nonempty finite set F C G 
becomes more and more left invariant, where cpa(F) denotes the maximum of the cardinalities of 
the independence sets for A which are contained in F. A tuple (x\, . . . , Xk) G X k is an IE-tuple 
if for every product neighbourhood U\ X • • • x Iff. of (xi, . . . , Xk) the independence density I(U) 
of the tuple U = (U\, ...,[/&) is positive. 

To establish Theorem l4.8l we need the following version of the Rokhlin lemma for sofic approx- 
imations, which appears as Lemma 4.6 in [26]. For A > 0, a collection of subsets of {1, ... ,d} is 
said to X- cover {1, . . . , d} if its union has cardinality at least Xd. 

Lemma 4.7. Let G be a countable amenable discrete group. Let < r < 1 and < rj < 1. Let 
K be a nonempty finite subset of G and 5 > 0. Then there are an £ G N, nonempty finite subsets 
F\, . . . , F# of G with \KFk \ F^\ < 5\F^\ and {F^K \ Fk\ < 5\F^\ for all k = 1, . . . ,£, a finite set 
F C G containing e, and an rj > such that, for every d G N, every map a : G — > Sym(ci) for 
which there is a set B C {1, . . . , d} satisfying \B\ > (1 — r]')d and 

a st {a) = a s a t (a),a s (a) ^ a s >(a),a e (a) = a 

for all a G B and s, t,s' G F with s ^ s' , and every set V C {1, . . . , d} with \ V\ > (1 — r)d, there 
exist Ci, . . . , C( C V such that 

(1) for every k = 1, . . . ,£, the map (s, c) i— > a s (c) from F^ x Ck to a(Fk)Ck is bijective, 

(2) the family {a(Fi)C\, . . . , a(Fi)C{\ is disjoint and (1 — r — rf)-covers {1, . . . , d}. 

Theorem 4.8. Suppose that G is amenable. Then IE-tuples, orbit IE-tuples, T,-IE-tuples, and 
sofic IE-tuples are all the same thing. 

Proof. By Proposition 14.61 sofic IE-tuples and S-IE-tuples are orbit IE-tuples. That orbit IE- 
tuples are IE-tuples is clear in view of the definition of the independence density 1(A) of a 
tuple A of subsets of X. It thus remains to show that IE-tuples are both sofic IE-tuples and 
S-IE-tuples. 

To prove that IE-tuples are E-IE-tuples, it suffices to demonstrate that, given a tuple U = 
(Ui, . . . , Uk) of subsets of X with I(U) > 0, the tuple U has positive upper independence density 
over X. Set A = I(U) > 0. Let F be a nonempty finite subset of G and S > 0. 

Let rj > 0, to be determined. By Lemma 14.71 we can find an I G N and nonempty finite sets 
Fi, ■ ■ ■ ,Fi C G such that (i) the sets Fi,...,F( are sufficiently left invariant so that for each 
i = 1, . . . ,£ there is a set J« C Fi which is an independence set for U and has cardinality at 
least A|Fj|/2, and (ii) for every good enough sofic approximation a : G — > Sym(d) there exist 
Ci, . . . , Ce C {1, . . . , d} satisfying the following: 

(1) for every i = 1, . . . ,£ and c G Ci, the map s h-> a s (c) from Fj to a(Fi)c is bijective, 

(2) the family of sets cr(Fi)c for i = 1, . . . , £ and c G Ci is disjoint and (1— ?7)-covers {1, . . . , d}. 
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Let a : G — > Sym(d) be a sufficiently good sofic approximation for G for some d G N. For 
every h = (hi, ... , hg) G Fj| =1 X * take a map iph : {1, . . . , d} — >■ X such that 

<Ph(sc) = s(hi(c)) 

for all i G {1, ...,£}, c G Ci, and s G i^. We may assume in our invocation of Lemma 14.71 above 
that the sets Fi,...,Fi are sufficiently left invariant so that, assuming that 77 is sufficiently 
small and a is a sufficiently good sofic approximation, we have (fh G Map(/?, F, 5, a) for every 
h G n!=i ^ C '- Write a for the subset |j|=i Use J, UceQ ^(c) of {1, ... , d}. From (1) and (2) we 
obtain 

131 = E \Ji\\Ci\ > E ^\Ft\\Ci\ > ^(1 - »7)rf > ^ 

1=1 i=l 

assuming that 77 < 1/2. Now whenever we are given uii G {1, . . . , k} Ji for i = 1, . . . ,£ we can 
find, since each Jj is an independence set for L7, an h = (hi, . . . ,hf) G Yli=iX Ci such that 
shi(c) G ^i(s) f° r all £ = 1, • • • ,i and s G Jj. The maps y?^ for such h then witness the fact that 
3 is a (p, F, 5, cx)-independence set for U. It follows that U has positive upper independence 
density over S. Hence IE-tuples are S-IE-tuples. 

The above argument also shows that IE-tuples are sofic IE-tuples, and so we are done. 

One can also give the following direct proof that IE-tuples are orbit IE-tuples. It suffices 
to show that if A = (A\, . . . , Ak) is a tuple of subsets of X and q > is such that for every 
nonempty finite subset K of G and e > there exist a nonempty finite subset F of G with 
\KF \ F\ < e\F\ and a J C F with \ J\ > q\F\ which is an independence set for A, then the 
independence density of A over G is at least q. Let Fi be a nonempty finite subset of G. Let 
1 > <5 > 0. Take e > be a small number which we shall determine in a moment. Then there 
exist a nonempty finite subset F of G with \F± 1 F \ F\ < e\F\ and a J C F with |J| > g|.F| 
which is an independence set for A. Set F' = {s G F : s C i* 1 }. Taking e to be small enough, 
we have > (1 — Note that the function Y^seF ^f 1 s has value at every point of F' . 

Thus 

E E W*) = l^nF'||F 1 |. 

t£j(lF' s€F 

We also have 

E EW*) = E E iF ls (t) = Ei i? i sn ( Jni?/ )i- 

teJnF'sgF seFteJnF' seF 

Therefore we can find an s 6 F with 

|F lS n(JnF')| > |Jn ,!!| l|i?l1 > (g-Wil. 

\r | 

Since Fin(Jni ?/ )s _1 is an independence set for A, we deduce that F\ has a subset of cardinality 
at least (q — S)\Fi\ which is an independence set for A. Letting 5 — > 0, we get that Fi has a subset 
of cardinality at least q\Fi\ which is an independence set for A. Therefore the independence 
density 1(A) of A is at least q, and so we conclude that IE-tuples are orbit IE-tuples. □ 

The surprising fact above is that IE-tuples are orbit IE-tuples in the amenable case. It is clear 
however for a Bernoulli action that all tuples are orbit IE-tuples. Notice also that the argument 
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above works equally well if in the definition of E-IE-tuples we use positive upper independence 
density over E with respect to a fixed free ultrafilter J- 

Remark 4.9. The product formula for IE-tuples as defined in the amenable framework was 
established in Theorem 3.15 of [23J using a measure-theoretic argument. We can now combine 
Theorems 14.81 and 13.31 to obtain a combinatorial proof. 

Remark 4.10. The proof of Theorem 14. 81 shows that the independence density 1(A), as defined 



on page 887 of 23] and recalled before the theorem statement, coincides with the independence 
density defined in Definition 13.11 We may thus use the notation L(A) without ambiguity to 
denote the more general independence density of Definition 13.11 

Remark 4.11. When G is amenable, it is clear from the classical (n, e)-separated set formulation 
of topological entropy that the entropy of an action G rx X is bounded below by the supremum 
of 1(A) log k over all pairs (k, A) where k £ N and A is a /c-tuple of pairwise disjoint closed 
subsets of X. For Bernoulli actions the two quantities are equal. In the nonamenable case, the 
entropy fails in general to be bounded below by sup( fc A \ 1(A) log k, where 1(A) is as defined 
in Remark 14.101 Indeed an example of Ornstein and Weiss [35l . Appendix C] shows that the 
Bernoulli action F% rx {0, l}^ 2 over the free group on two generators has Bernoulli factors over 
arbitrarily large finite sets of symbols, in which case the supremum is infinite. 

We next aim to establish some basic properties of E-IE-tuples in Proposition 14.161 
From Lemma 3.6 of 1 231 we obtain: 



Lemma 4.12. Let k £ N. Then there is a constant c > depending only on k with the following 
property. Let A = (A\, . . . , Ak) be a k-tuple of subsets of X and suppose A\ = Ai^i U Ai^- Let 
F be a nonempty finite subset of G and 5 > 0. Let a be a map from G to Sym(d) for some 
d E N. Lf a set J C {1, . . . , d} is a (p, F, 5, a) -independence set for A, then there exists an L C J 
such that \L\ > c\J\ and L is a (p, F, 5, a) -independence set for (A\ t i, . . . , Ak) or (^4i,2, • • • , Ak). 

From Lemma 14.121 we get: 

Lemma 4.13. Let A = (A±, . . . , Ak) be a k-tuple of subsets of X which has positive upper 
independence density over E. Suppose that A\ = A\ t \ U A\^. Then at least one of the tuples 
• • • , Ak) and (^4i,2j ■ ■ ■ > Ak) has positive upper independence density over E. 

Lemma 4.14. hs(X,G) > if and only if there are disjoint closed subsets Aq and A\ of X 
such that (Aq,A\) has positive upper independence density over S. 

Proof. Let p be a compatible metric on X with diam p (X) < 1. Then /ie,oo(p) = h^,(X,G). 
The "if" part is obvious. So assume h-£ j00 (p) > 0. Then h^ OQ (p) > for some e > 0. Set 
c = h% 00 (p)/2. 

Take a finite (p, 2e)-dense subset Z of X. Consider on X the continuous pseudometrics p z , 
for z G Z, and p' given by 

P z (%,y) = \p(x,z) - p(y,z)\, p'(x,y) = maxp z (x,y). 

Note that if p(x,y) > 6e for some x,y £ X, then p'(x,y) > 2e. It follows that if d E N and cp 
and ij) are maps from {1, . . . , d} to X with poo((p, tp) > 6s, then p'^ip, tp) > 2e. 

Take an increasing sequence {i^jng^ of nonempty finite subsets of G with union G and a 
decreasing sequence {5 n }neN of positive numbers converging to 0. For each n 6 N, there is 
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a cofinal set I n of i for which one has NQ e (Map(p, F n , 5 n , <7j), poo) > exp(cdj). We then have 
A r 2 £ (Map(/9, F n , 5 n , <Ti), p'^) > exp(cdi) for all i G I n . For each i £ L n and z £ Z take a (p^e)- 
separated subset Wj )2 of Map(p, F n , <5 n , (Xj) of maximum cardinality. Then 

N2 £ (Map (p, F n ,5 n ,ai), p'^ ) < J] \Wi, z \ = ]J A £ (Map(p,F n 

z&Z z&Z 

Thus N £ (M&p(p, F n ,5 n ,ai), pt£' 1 ) > exp(cdi/\Z\) for some z n ^i G Z. Replacing I„ by a confinal 
subset if necessary, we may assume that z n ,i is the same, say z n , for all i £ I n . Passing to a 
subsequence of {(F n , <5 n )} n eN if necessary, we may assume that z n is the same, say 3, for all 
n G N. 

Note that if W is a (p^ , e)-separated subset of Map(p, F n , 5 n , <7j), then the set {p(3, •) o tp : 
tp £ W} in is (|| • ||oo, e)-separated. By [la, Lemma 2.3], there are constants c' and <5 > 
depending only on c/\Z\ and e such that for every n G N and large enough i £ I n there are a 
^n,i G [0, 1] and a subset J n> j of {1, ... , dj} with \J n ,i\ > c'di so that for every u : J n ^ — > {0, 1} 
there are a tp w £ Map(p, F n , 5 n , at) such that for all a £ J n ^ we have p(^,ip u] (a)) > t n> i + 5 or 
p(3; fwip)) < in,j — <5 depending on whether w(a) = or w(a) = 1. Replacing I n by a confinal 
subset if necessary, we may assume that there is a t n £ [0,1] such that \t n< i — t n \ < 5/4 for 
all i £ I n . Replacing {F n ,5 n } n ^ by a subsequence if necessary, we may assume that there 
is a t £ [0,1] such that \t n - t\ < 6/4 for all n £ N. Set A = {x £ X : p{i,x) > t + 5/2} 
and A\ = {x £ X : p($,z) < t — 5/2}. Then for every n £ N and i £ I n , the set J n ^ is 
a (p, F„, <5 n , ^-independence set for (Aq, A\). Thus (Ao, Ai) has positive upper independence 
density over S. □ 

The following is obvious. 

Lemma 4.15. hj](X,G) > if and only if X as a 1-tuple has positive upper independence 
density over X. 

Proposition 4.16. The following are true: 

(1) Let (Ai, . . . , A}/) be a tuple of closed subsets of X which has positive upper independence 
density over S. Then there exists a Ti-IE-tuple (x%, . . . , x^) with Xj £ Aj for all 1 < j < 
k. 

(2) IEf(X, G) is nonempty if and only ifh^,{X,G) > 0. 

(3) IE2 (X, G) \ A2(X) is nonempty if and only if hz(X,G) > 0, where A2(X) denotes the 
diagonal in X 2 . 

(4) IEfc(X, G) is a closed subset of X k which is invariant under the product action. 

(5) Let 7T : {X, G) -> (Y, G) be a factor map. Then (vr x • • • x vr)(r£f (X, G)) C IE^Y, G). 

(6) Suppose that Z is a closed G -invariant subset of X. Then IE^Z, G) C IE^(X,G). 

Proof. Assertion (1) follows from Lemma 14.131 and a simple compactness argument. Assertion 
(2) follows from assertion (1) and Lemma 14.151 Assertion (3) follows directly from assertion (1) 
and Lemma 14.141 Assertion (4) follows from the observation that, given a compatible metric 
p of X, for any s £ G, nonempty finite subset F of G, and 5 > there is a 5' > such that, 
for every d £ N and map a : G — > Sym(d) which is a good enough sofic approximation for 
G, if (f G Map(p, {s^ 1 } U (s^ 1 F) , 5' , a) , then a s o <p o <r s -i G Map(p, F, 5, a), where a s is the 
transformation x >— > sx of A. Assertions (5) and (6) are trivial. □ 
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Remark 4.17. The inclusion in (5) above is an equality when G is amenable, since X-IE-tuples 
are the same as IE-tuples by Theorem 14.81 Equality can fail however if G is nonamenable: Take 
an action G rx X with hs(X,G) = —oo and an action G r\ Y with h-£(Y,G) > 0. Then 
G rx Y has a nondiagonal S-IE-pair, while the product action G rx X x Y , which factors onto 
G rx Y via the second coordinate projection, satisfies hs(X X Y, (?) = — oo and hence has no 
nondiagonal S-IE-pairs. 

Remark 4.18. The analogue for orbit IE-tuples of the localization in Proposition 14. 16T l) does 
not hold in the nonamenable case. Indeed for any action G rx X of a discrete group the 1-tuple 
X has positive independence density, while the boundary action F2 rx dF2 of the free group 
on two generators (where <9i<2 consists of infinite reduced words in the standard generators and 
their inverses, with the action by left concatenation and reduction) is easily seen not to admit 
any orbit IE-l-tuples. 

From Proposition 14.16( 5) we get the following. As in Theorem I3.3( the inclusion below 
is understood with respect to the identification of ((a?i, . . . ,a?fc), (j/i, • • - , 2/fc)) G X x Y k and 
((xi,yi),...,(x fc ,y fc )) e (X x Y) k . 

Proposition 4.19. IEf(X x7,G)C IE%(X,G) x IEj^Y, G). 

The problem of the reverse inclusion will be taken up in the next section. 

For the remainder of this section X is the unit ball of £ P (G) for some 1 < p < 00 equipped 
with the pointwise convergence topology, and the action G rx X is by left shifts. We will use 
some of the above results to compute the sofic topological entropy of this action to be zero when 
G is infinite. 

Recall from the end of Section [3] that a tuple x = (xi, . . . ,x k ) G X k is an IN-tuple if for every 
product neighbourhood U\ X • • • X U k of x the tuple (U\, . . . , U k ) has arbitrarily large finite 
independence sets. We write lN k (X, G) for the set of IN-tuples of length k. 

Lemma 4.20. For every k G N the set INfc(X, G) consists of the single element (0, . . . , 0). 

Proof. Clearly (0, . . . , 0) G IN fc (X) for every k G N. Also note that if x = {x\, . . . , x k ) G IN fc (X) 
then xi,...,x k € INi(X). Thus it suffices to show INi(X) C {0}. 

Let x G X with x ^ 0. Then (tx) e 7^ for some t G G. Set r = |(tx) e |/2 > and 
U = {y G X : \y e \ > r}. Then U is a neighborhood of tx in X. Let F C G be a finite 
independence set for U. Then HseF s~ l U is nonempty. Take y G HseF s~ 1 U '. Then sy G U and 
hence |y s -i| = |(sy)e| ^ r f° r every s £ F. It follows that 

\F\rP<Y,\y s -A p <\\y\\ p P <^ 

and hence \F\ < r~ p . Therefore tx INi(X). Since INi(X) is G-invariant, x INi(X). □ 
Proposition 4.21. Suppose that G is infinite. Then h^(X,G) = 0. 

Proof. By Lemma [4. 201 Propositions 14. 16T 2) . and Propositions 14.6 1 and \3A[ we have h^(X,G) < 
0. Since X has the fixed point 0, we have hs(X, G) > 0. Therefore hs(X, G) = 0. □ 
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5. Product Formula for IE-tuples 

In order to hope for a product formula for S-IE-tuples beyond the amenable case, we must 
be able to witness independence density in some uniform way, in analogy with the definition of 
orbit IE-tuples in Section [3] (see Theorem 13, 3D . This can be achieved by taking a free ultrafilter 
J on N and requiring that the independence sets in Definition 14.21 exist for a set of i belonging 
to 5 instead a cofinal set of i. Thus for the purposes of this section we fix a free ultrafilter $ on 
N and switch to definition of E-IE-tuples based on this interpretation of positive density. We 
will similarly understand sofic topological entropy to be defined by using an ultralimit over $ 
in Definition 12.51 instead of the limit supremum. We do not know whether our product formula 
results, Proposition 15. II and Theorem I5.2[ hold for the original definitions. 

For the first part of our discussion, up to and including Lemma 15.61 G is a countable sofic 
group and S = {<7j : G —> Sym(dj)}^. 1 a fixed but arbitrary sofic approximation sequence for G. 

Proposition 5.1. Let G act continuously on compact metrizable spaces X and Y . Then 

hx(X xY,G)= hv(X, G) + h E (Y, G). 

Proof. Fix compatible metrics p x and p Y on X and Y respectively. Define a compatible metric 
pxxY on X x Y by 

p XxY ((x 1 ,y 1 ), (X2,y 2 )) = p X (x 1 ,x 2 ) + p Y (2/1,2/2) 

for (2:1,2/1), (2:2,2/2) 6 X x Y. 

Let d G N. Identify (X x F){b-,d} w ith X* 1 --^ x yft-.d} naturally. Note that for all 
cp,(p' G Xt 1 --'^ and G yUv-,4 one h as 

max (p x (<p, <p'),p Y (iP, i>')) < p^ xY ((ip, fjf), VO) < fg(<P, f') + f%ty, ^)- 

Let F be a nonempty finite subset of G, 5 > 0, and £ > 0, and let a be a map from G to 
Sym(d). Then Map (p x , F, 5, a) x Map(p y , F, 5, a) C Map(p Xxy , F, 2<5, a). Furthermore, for 
every (p^, e)-separated subset #x of Map (p x , F, 5, a) and every (p Y , e)-separated subset #y of 
Map(/9 X ,F,(5,cj), the set W x x >Fy is (p^ xy , e)-separated. It follows that hj, 2 (p XxY , F, 25) > 

h h,2 i.P X i F , s ) + h h,2 (P Y > F ^) . and hence (X x y, G) > /is (X, G) + /is (K, G) . 

Note that for any {p x , e)-spanning subset #x of M&p(p x , F,5,a) and any (p y , e)-spanning 
subset Wy of Map(p x , F, <5, a), the set #x x is (pf xY 1 2e)-spanning for (though not neces- 
sarily contained in) Map(p Xxy , F, 5, a). It follows that N 4e (p XxY , F, 5, a) < N £ (p x , F, 5, a) x 
N £ (p Y ,F,5,a), and hence /iff 2 (p x x y , F, <5) < /i| 2 (p x , F, 5) + fcf, 2 (/j y , F, 5). Consequently, 
/is(X x y G) < /i E (X, G) + hv(Y, G). " " □ 

The Loeb space and the Loeb measure were introduced by Loeb in [34]. An exposition 
can be found in [l|]. The Loeb space is the ultraproduct space T7^{1, . . . , d{\. A subset Y 
of Ilgi 1 ' • • • j^i} i s called internal if it is of the form YlgYi for a sequence {y}j g N with y C 
{1, . . . , di} for all i G N. The collection 3 of inner subsets is an algebra. The Loeb measure is the 
unique probability measure \x on the cr-algebra 03 generated by 3 such that p(Y) = lim^y \^i\/di 
for every internal set Y = Yl^^i- For every Z G 23 there exists a y G 3 such that fi(YAZ) = 0. 

For each cf G N, denote by puamm the normalized Hamming distance on Sym(cZ) defined by 

/OHamm^r) = ~|{d G {1, . . . , d} : t(o) / T'(a)}\. 



IS 



DAVID KERR AND HANFENG LI 



The ultraproduct group FJg Sym(dj) has a natural action on ns{l> • • • > preserving p. One 
has a bi-invariant pseudometric pl on ]\% Sym(<ij) defined by pl(t, t') = p{{y G rij?{l> • • • > di} '■ 
T V / r 'y})- For any r = (r^^r' = (r/)i G J]s Sym(dj) with Ti,T- G Sym(dj) for all i G N, 
one has p l {t,t') = lim^ /9Hamm(Tj, r-). Denote by the quotient group of n;jSym(dj) by p L . 
Then we may think of (5 as acting on n#{l' • • • >^i} by ^-preserving transformations. 

The sofic approximation sequence £ gives rise to a natural group embedding of G into 0. 
Thus we may think of G as a subgroup of (5. Denote by G' the subgroup of <3 consisting of 
elements commuting with G. 

As before, the equality below is understood with respect to the identification of 
((xi,...,x fc ),(yi,...,y fc )) G X k x Y k and ((a?i, yi), . . . , (x k , y k )) G (X x 

Theorem 5.2. Suppose that the action of G' on (YI${1, ■ ■ ■ , di}, *8, /i) is ergodic. Let G act 
continuously on compact metrizable spaces X and Y . Let k G N. T/ien 

Df(X x Y, G) = IEf(X, G) x IE^y, G). 

We prove the theorem by way of the following results. 

Definition 5.3. Let G act continuously on a compact metrizable space X. Let p be a dynami- 
cally generating continuous pseudometric on X. Let A = (A\, . . . ,Ak) be a tuple of subsets of 
X. We say that an internal set Y = Yi with Y{ C {1, . . . , di} for all i G N is an independence 
set for A if for every nonempty finite subset F of G and every 5 > the set of all i G N for 
which Yi is a (p, F, 5, crj-independence set for A belongs to 

From Lemma 12.31 it is easy to see that Definition 15.31 does not depend on the choice of p. 

Consistent with our interpretation of the equality in Theorem 15.21 in Proposition 15.41 and 
Lemma [5.61 we understand AxBto mean (A\ x Bi, . . . , A/~ x B k ) where A = (A\, . . . , A^) and 
B = (Bi, . . . , Bk). 

Proposition 5.4. Let G act continuously on compact metrizable spaces X and Y . Let A and 
B be k-tuples of subsets of X and Y respectively for some k £N. Then the following hold: 

(1) A has positive upper independence density over £ if and only if A has an internal 
independence set Z with p(Z) > 0. 

(2) The set of internal independence sets for A is G' -invariant. 

(3) An internal set is an independence set for Ax B if and only if it is an independence set 
for both A and B. 

Proof. Fix a compatible metric p on X which gives X diameter at most 1. 

(1). The "if" part is obvious. Suppose that A has positive upper independence density over 
S. Let q > be as in Definition 14.21 Let {.F n } ng N be an increasing sequence of finite subsets of 
G with (J n€ N F n = G. For each n G N, denote by W' n the set of all i G N for which there is a 
(px,F n , 1/n, Oi )-independence set Z{ for A with Ci^i) > q. Also set W n = W' n \ {1, . . . , n — 1}. 
Then W' n G J by our assumption and hence W n G 5 for each n G N. Note that the sequence 
{W n } n& % is decreasing, and C\ n& nW n = 0. 

We define an internal set Z = Z{ as follows. If % G N \ W\, we take any Zi C {1, . . . , di}. 
If i G W n \ W n+ \ for some n G N, we take Zi to be a (p, F n , 1/n, cjj)-independence set for 
A with \Zi\/di > q. Then Zi is a (p, F n , 1/n, <7j)-independence set for A for all n G N and 
i G W n . Thus Z is an internal independence set for A. As \Zi\/di > q for all i G W\, we have 
p(Z) = limj-^ C(-^i) ^ 1- This proves the "only if" part. 
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(2) . Let Z = Yl$Zi be an internal independence set for A, and let r = (rj)j G G' . Then 
tZ = n^TiZi. Let F be a nonempty finite subset of G and 1 > 5 > 0. Then the set W of all 
i G N for which Zj is a (p, F, 8, <7j)-independence set for A is in J. Since r G G', the set V of 
alH G N for which max s &F PHamm^ -1 ^.,, Ci,*^ -1 ) < <5 2 is also in Then V D W is in For 
every i 6 7, ^ 6 Map(p, F, <5, (jj), and s £ F one has 

p 2 (a s Ol/'O^'^OT^O cr iiS ) 

< p 2 (a s 0(fO Tj" 1 , (/? O a iiS O Tj _1 ) + p 2 (<p ° a i,s Tj" 1 ! ^ ° ° ^m) 

< p 2 (a s cup, if o a i;S ) + (/OHammlV 1 ° °Vj °M ° r r 1 )) 1/2 

<5 + 5 = 25, 

where a s is the transformation x i— >• sx of X, and hence <p o r^ 1 G Map(p, F, 25, dj). It follows 
that for every i G V n W the set TjZ.j is a (p, F, 25, <Tj)-independence set for A. Therefore tZ is 
an internal independence set for A. 

(3) . This can be proved using arguments similar to the proof of Proposition 15.11 □ 

Lemma 5.5. Suppose that T is a subgroup of <5 and the action ofT on ■ ■ ■ , d{\, 93, p) is 

ergodic. Let Y,Z G 93 be such that p(Y), p(Z) > 0. Then p(Y n tZ) > for some t G V. 

Proof. Set r = sup F p({J t€ f tZ) with F ranging over the nonempty countable subsets of F. 
Then we can find nonempty finite subsets Fi, F 2 , . . . of T such that r = lim^^oo p(\J T £F n tZ). 
Set W = lJ nG N F n and Z' = lj re vy Then W is a countable subset of V and r = p(Z'). For 
every r' G T we have p(Z U r'Z) = pUJtgwut'w < r an d hence p{j' Z \ Z) = 0. Since the 
action of T on (n#{l> • • • > ^i}> ®> A 4 ) i s ergodic, we conclude that r = 1. Thus = fji(Yr\Z') < 
Y^ T( z W p(Y n rZ), and hence p(Y n rZ) > for some t £W. □ 

Lemma 5.6. Suppose that the action of G' on (JI${1, . . . ,di},%$, p) is ergodic. Let G act 
continuously on compact metrizable spaces X and Y . Let k G N and let A and B be k-tuples of 
subsets of X and Y, respectively. Suppose that both A and B have positive upper independence 
density over E. Then Ax B also has positive upper independence density over E. 

Proof. This follows from Proposition 15.41 and Lemma 15.51 □ 

Theorem 15.21 now follows from Proposition 14.191 and Lemma 15.61 

The remainder of this section is devoted to the problem of when the ergodicity hypothesis in 
Theorem 15.21 is satisfied. We prove that this happens when G is residually finite and E arises 
from finite quotients of G, and also when G is amenable and E is arbitrary. A combination of 
results of Elek and Szabo [l3|, Thm. 2] and Paunescu [36[ shows on the other hand that if G is 
nonamenable then there is always a sofic approximation sequence E for which the commutant 
G' does not act ergodically. 

Let G be an infinite residually finite group, and let {GjjjgN be a sequence of finite-index 
normal subgroups of G such that HneN Ui>n C« = i e }- Then we have the sofic approximation 
sequence E = {o~i : G — > Sym(|G/Gj|)} by identifying {1, . . . , \G/Gi\} with G/Gi and setting 
ai{s)(tGi) = std for s,teG. 

Theorem 5.7. Under the above hypotheses, the action of G' on ■ ■ ■ , \G/Gi\}, 93, p) is 

ergodic. 
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Proof. Consider the right multiplication action a' of G/Gj on itself given by u\ (sGj)(iGj) = 
ts^d for s,t G G. Since this commutes with ai, it suffices to show that the action of 
U^'i(G/Gi) C G' on (n ff {l,...,|G/G i |},?8,/i) is ergodic. 

Let C G/Gi. Then, using the ^ 1 -norm with respect to the uniform probability measure on 
G/G h 

1 



\G/G 



11 sGi£G/Gi 



E 



> 



E i 



IG/G.I-lv 



sGieG/Gi 



IVil-l 



|G/Gi|-ly n 



I G/^ 



|G/Gi| - |y* 



Thus there is some SjGj G G/Gj with | G / G - |o"j(giGj)ViA^i| > 2| G y G -y(l — | G / G . 

Let y = fjg be an internal subset of . . . , |G/G n |}. Take s^Gj G G/Gj as above for 

each ieN. Set s = (sjGj)j. Then 



/i(o-'(s)yAY) 



lim 



I G/Gi | 



1 



If /i(<r'(s)y"Ay) = 0, then /j,(Y) 



\G/G 

or 1. This finishes the proof. 



2 M (y)(i-/i(y)). 



□ 



Theorem 5.8. Let G be a countable amenable group. For every sofic approximation sequence 
£ /or G, £/ie action of G' on (n#{l> • • • > ®i A 4 ) * s ergodic. 

The proof of Theorem 15.81 requires several lemmas. 

We will use the following terminology. Let (X, /i) be a finite measure space and let 5 > 0. A 
family of measurable subsets of X is said to 5-cover X if its union has measure at least Sfi(X). 
A collection {^4j}j g / of positive measure sets is 5-disjoint if there exist pairwise disjoint sets 
Ai C Ai such that fJ,(Ai) > (1 - o")/x(Aj) for all i G /. 

The following is the Rokhlin lemma for sofic approximations,which is based on the quasitiling 
theory of Ornstein and Weiss and appears as Lemma 4.5 in [261 ]. The statement of the latter 
does not contain condition (3) below, but it is not hard to see from the proof in [261 ] that it can 
be arranged. 

Lemma 5.9. Let G be a countable discrete group. Let < < 1, and < r) < 1. Then there 
are an £' G N and k, rj' > such that, whenever e G F\ C i*2 Q • • • C F# are finite subsets of G 
with KFjT^Fj.) \ Fk\ < k\F^\ for k = 2, ...,£' , there exist Ai, . . . , Xy G [0, 1] such that for every 
5 > 0, every sufficiently large d G N ( depending on 5 ), every map a : G — > Sym(ci) with a set 
B C {1, . . . , d} satisfying |B| > (1 - r/")d and 

a st (a) = o- s a t (a), a s {a) / a s >(a), a e (a) = a 

for all a G B and s, t, s' G Fy UF^T 1 with s ^ s' , and every set V C {1, . . . , <i} wii/i |V| > (1 — 9)d, 
there exist Si, . . . , 6^ C V swc/i i/iai 
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(1) for every k = 1, . . . ,£' and c E the map s h-> ct s (c) /rom Ffc to a(Fk)c is bijective, 

(2) i/ie sets o"(F 1 )Ci, . . . , cr(i^/)C^/ are pairwise disjoint and the family Ui=i{°"(-^fc) c : c E C/J 
is rj-disjoint and (1 — 8 — r])-covers {1, . . . , d}, 

(3) ELilkCWfc|/d-A fc | <«5. 

Lemma 5.10. Let G be a countable discrete group. Let F be a nonempty finite subset of G. 
For every d E N, every map a : G — > Sym(d), every set ¥> C {1, . . . , <i} satisfying 

a s (a) / (r t (a) 

/or all a £ B and distinct s,t £ F, every 3 C {1, . . . , d}, and every < A < 1, i/iere exists a 
VCS suc/i taai |V| > |3|(1 ~ A) ~ d+|a| and |a(F)a n 3\ > A|F| /or a// a E V. 

Proof. Set X = {1, . . . , d}. Denote by £ the uniform probability measure on X. One has 
- Y W(F)a n 01 = / E UF)a(x) dC(x) 



/ ^2 1 cr(F)a(.x)dC(x)- ^ l^ F ) a (x) dC(x) 

JX a£3 JX \ 3 aG« 



1231 • |F| /" 

>L-LLd_ \F\dC(x) 

d Jx\3 
BMF| ^,4llFI. 



d \ d 
Set V = {a E B : |<r(F)a n 0| > X\F\}. Then 



Thus 



It follows that 



S| gW .na|<LU-l + " V 



|V[-|F| | (|S|-|V|)A|F| > \V\.\F\ f ± \3\' ]iyi 
d d ~ d 



\v\ > \m-v-d+\3\ ^ □ 



l-A 

The proof of Lemma 4.4 in [26[ shows the following. 

Lemma 5.11. Let (X,fi) be a finite measure space. Let 5, n E [0, 1) and let {^4j}j g / be a finite 
5-even covering of X by positive measure sets. Then every rj-disjoint subcollection of {Ai}i e j 
can be enlarged to an rj-disjoint subcollection of {Ai}i e j which n(l — 5)-covers X. 

Lemma 5.12. Let G be a countable discrete group. Let F be a nonempty finite subset of G, 
< r < 1, and < n < 1/2. Then for every large enough d E N, every map a : G — > Sym(d) 
with sets Bi,S2 Q {1, ... ,d} satisfying |Bj| > (| + ^~ 2T )d and 

a s (a) ^ i7t(a) 

/or all a £ Hi and distinct s,t E F, and every 3i,d2 S {1, . . . ,d} mi/i > rd /or i = 1,2, 
there exist Cj C Bj such that 

(1) /or ewerj/ i = 1,2, the family {a(F)c : c E Cj} is rj-disjoint and rj^-covers {1, . . . , d}, 



22 DAVID KERR AND HANFENG LI 



(2) there is a bijection tp : Gi — > C2 such that for any c 6 Cj, one has \{s £ F : a s (c) E 

ai,^(c))ea 2 }|>(i) 2 in 

Proof. Note that for all distinct a, c G {1, . . . , d} and s £ F we have 

cr s (a) / cr s (c). 

Taking A = t/2 and J = 3i in Lemma 15.101 we find a Vi C such that > 

\M^m^±Ml± > (r/2 + (2-2r)/(2-r))(l-A)-l+r = . ^ R > . for ^ fl £ ^ 

Observe that 

2 k(F)c| = |F| ■ |Vi| > \F\ ■ U = \F\ ■ (l - ^-^d, 



ceV 

so that the family {a{F)c\ c ^y 1 is a ^^-even covering of {l,...,rf} with multiplicity By 
Lemma 15.111 we can find a set Wi C Vi such that the family {a(F)c} c ^ 1 is ^-disjoint and 
ry^-covers {1, . . . ,d}. We may assume that |cr(F)Wi| < rjrd/2 + \F\. 

List all the subsets of F with cardinality [|F|r/2] as Fx, ... ,F n for some n £ N, where \x\ 
for a real number x denotes the smallest integer no less than x. Then we can write as the 
disjoint union of sets Wi j for 1 < j < n such that a(Fj)c C 3x for all 1 < j < n and c G Wij. 
Throwing away those empty Wi^, we may assume that each Wij is nonempty. 

For each 1 < j < n, taking A = r/2 and 3 = 32 in Lemma [5,10| we find a V2 j C S2 such that 

|Vjw|/d > \V 2K X-X)M-X + \3 2 \/d > (r/2 + (2-2r)/(2-r))(l-A)-l+r = r &nd \ a{Fj)a n h \ /\ Fj \ > I for 

all a e V2J. 

We will recursively construct pairwise disjoint sets 62,11 • • • > 62, n such that the family {<r(.F)c : 
c G C2J, 1 < j < n} is r/-disjoint, and C2J Q V2J and |C2j| = U^ijl/^J for every 1 < j < n, 
where [^J for any real number x denotes the largest integer no bigger than x. 

Note that 

£ |a(F)c| = |F| • |V 2)1 | > \F\ ■ U = \F\ ■ (l - ^)d, 

cev 2 ,i 1 \ * J 

so that the family {<r(F)c} cg v 2 1 is a ^^-even covering of {1, ... , d} with multiplicity \F\. By 
Lemma I5.1H we can find a set W 2) i Q V2 1 such that the family {o~(F)c} c€ yj 2 1 is 77-disjoint and 
77^-covers {1, . . . , d}. Note that 

|W 2 ,i| • \F\ > \a(F)W 2 ,x\ >V~d, 
and since the family {a(F)c} c€ w 1 is 77-disjoint, we have 
(1) |]Wi| - \F\ < (l-r?)|Wi| - \F\ < \a(F)Wx\ <r/^d+\F\. 

Thus 

-|Wi| • \F\ < \W 2 ,x\ ■ \F\ + \F\, 



and hence 



|W 2 ,i| > ||Wi| - 1 > ||Wi,i| - 1. 



Therefore we can take a subset 62,1 of W24 with cardinality |_^- |"Wi,i | J - 
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Suppose that we have found pairwise disjoint sets 62,1 , • • • > &2,k for some 1 < k < n such that 
the family {a(F)c : c G e 2 j, 1 < j < k} is ??-disjoint, and C 2 ,j C V 2j - and \Q2j\ = |_|Wij|/2j fo r 
every 1 < j < k. Note that 



E k(*>l = 1*1 



v 2 , w u |J e 2 , 



> |F| • |V 2 , fc+ i| > |F| • ~d = \F\ ■ ( 1 - ^-1 Id, 



so that the family {CT(F)c} cgV2 fc+1 u(J 1< <fc e 2 j * s a ^--even covering of {l,...,d} with multi- 
plicity |F|. By Lemma f5. Ill we can find a set W 2; fc + i C V 2) fc +1 \Ui<j<fc ^ 2 ,j such that the family 
{ <7 ( j P') c }ce'W2 A,+iU(J 1< . <fc e 2 j * s ^-disjoint and r^^-covers {!,..., d}. Note that 



(W +1 | + E |e 2J |W|> a(F)(w 2ife+1 u |J e 2J 



>^d. 



Thus, combining with ([I]), we have 
1 
2 



! E IWijI-lFl^IlWil-lFl 



< (W+i| + E |e 2j |) -|f| + |f| 

< (iw 2jfe+1 | + ~ e iwuiYm + m 



and hence 

|W 2 ,fc +1 | > i|Wi, fc+1 | - 1. 

Therefore we can take a subset C 2 ,fc+i of W 2i fc+i with cardinality L|l^i,fc+ilJ • This completes 
the recursive construction. 

For each 1 < j < n take a subset Cij of Wij with cardinality U"Wij|/2j. Set Sj = Ui<i<n 
for i = 1,2. Take a bijection <p : Ci — ?■ 6 2 such that yj(Sx,i) = C 2) ,- for all 1 < j < n. For each 
c G Si, considering j such that c G Cij one has 

\{s G F : cr s (c) G 0i,(T a (p(c)) G 2 }| > \{a G Fj : * a ((p(c)) G 3 2 }| 

2 



>^i>m in 



Note that 

|Wi| -|F| > |(r(F)Wi| >^d, 

and hence for i = 1,2, 



N= E l e d> E fliwi^i - 1) > ||w x | - 21^1 > i|Wx| 

l<j<n l<j<n \ ' ' 
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when d is sufficiently large. Since the family {a(F)c : c G Cj} is 77-disjoint, we get 

k(F)e<| > (1 - r?)!^! • |F| > (1 - V )r)~d > rt^-d. 

8 lb 



□ 



Lemma 5.13. Let G be a countable discrete group. Let < r < 1, and < r/ < 1/2 
??Yg < ^j-, where r' = | + ^E^ 1 < 1- ^Zien i/iere are an^sN and 77' > snc/i £/ia£, whenever 
e G Fi C F 2 C • • • C F> are /into sn&sete 0/ G KF^F*.) \ F fc | < |F fe | for k = 2, . . . ,£, 
for every large enough d G N, every ma/j a : G — )• Sym(d) wnt/i a set !B C {1, . . . , d} satisfying 
I *B I > (l-rj')d and 

a st (a) = a s a t (a), a s (a) ^ ay (a), a e (a) = a 

for all a G S and s,t,s' G F U F^ -1 u>i£/i s 7^ s' ; and any 81,82 ^ {1, . . . ,d} u>i£/i > Td /or 
i = 1,2, there exist Qn, ■ ■ ■ , Cj/ C B snc/i £/iai 

(1) for every i = 1,2, k = 1, . . . ,£ and c G Sjj., £/ie map s 1— > a s (c) from F k to a(F k )c is 
bijective, 

(2) for every i = 1,2, the sets cr(Fi)Cj 1, . . . , cr(F^)S^ are pairwise disjoint, the family 
Ufe=iMFfc)e : c G C^} is n- disjoint, and (1 - n)±=fd < \ \J e k=1 a(F k )e i>h \ < {j^^f + 
rj)d, 

(3) /or every k = !,...,£, there is a bijection ip k : Ci ^ — > &2.k such that for each c G 61 & 
one has \{s G F k : a s (c) G 3i,o- s ((f k {c)) G a 2 }| > (i) 2 |F fc |. 

Proof. Set 7/ = Take £ to be the largest integer satisfying ir\ jg < ^j^". Then ir/-^- > i^J- . 

We will recursively construct sets x , . . . , in reverse order so that (i) for every i = 1,2 and 
1 < k < I, the sets a{F k )Q' i k , . . . , a{F()Q' i e are pairwise disjoint and the family Un=fc{ a (Fi)c : 
c G C • n } is r/-disjoint and (£ — k + l)r/^-covers {1, . . . , d}, and (ii) for every k = there is 

a bijection (p k : 6^ fc — > C 2 fc such that for every c G fc one has |{s G F^. : 0" s (c) G 0i, a s (ipk(c)) G 
3 2 }| > (i) 2 |F fe |. 

Taking 24 = 2 for i = 1,2 in Lemma 15,121 we find 6j. C S for i = 1,2 such that the family 
{a(Fg)c : c £ G-J is //-disjoint and r/^-covers {1,... ,d} for i = 1, 2 and there is a bijection 
^ : C' M -> C 2/ with |{a G F* : o- s (c) G 3i,(7 a (^(c)) G 2 }| > (i) 2 |F^| for all c G C^. 

Suppose that 1 < k < i and we have found Q[ k+1 , . . . , C 23 for i = 1, 2 such that the sets 
a(Ffc + i)C^ fc+1 , . . . , o"(F^)C^ ^ are pairwise disjoint and the family Un=fc+i{ cr (Fi)c : c G C^} is 77- 
disjoint and — /c)r/jg-covers {1, . . . , d} for each i = 1,2, and there is a bijection (fj : Q[j — )• C 2j - 
with \{s G Fj : a s {c) G 3i, (T a (<Pj(c)) G a 2 }| > (i) 2 |F>| for all j = k + 1, . . . ,1 and c G 6'^. Set 
0i,k = \\Jj= k +MWij\/d and S i>fc = )ceB: o-(F fc ) C n ( [f j=k+l a^&ij) = 0} for i = 1,2. 

If 1 — t' — rj' < 38 mjk for some m = 1,2, then we set k = for each i = 1,2. Then 



EieU-l^l> 



U < F i) Q 'm,j 
j=k 



, 1 - r' - n' 1 - t' 
Vfcd > ^ " = — 7. — d. 
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Since the family \Jj =k {a(Fj)c : c G C-^} is r/-disjoint, one has 



U 

j=k 



>(i-*7)Eieyl-l^l 

> (1 - > > &7y^ > (£ — k + l)r,^d 



for t = 1,2. 

Assume that 1 — t' — rj' > 3#£ & for every i = 1,2. Let i G {1, 2}. For every c G 23 \ Bj & we 
have cr s (c) = cr t (a) for some j G {A; + 1, . . . ,£}, a G C- ■, t £ Fj, and s G and hence 



Therefore 



c = cj s -io- s (c) = cj s -icji(a) = a s - H {a) G (J cr(F fc l F j )Q' ij . 

j=k+i 



B\B,, fc C |J a^i^oe^, 
j=k+i 



Since the family Uj=fe+i{ (7 (-^j') c : c ^ ^ijl ^ s ^-disjoint we have 



E i^'i-i e M-i< E (i-vm\-K\< 



Thus 



i=fc+i 



U < F k l F 3 n,. 
j=k+i 



j=k+i 



< 



U °FiK 
j=k+i 



Oi.k.d. 



+ 



U ^{{F^F^F^ 
j=k+l 

e 

< E l(^i)\ ^1-1^1+^ 

j=k+l 
I 

< E l(^ r -i^)\ Fj\-\^ij\ + ^kd 
j=k+i 

< \Fj\-Kj\+kkd 

j=k+l 

< Wi hd. 



U 

j=k+l 



Therefore 



|S <jfc | = |B|-|S\B ijfc |>(l-r/)d- 



U <Fk l F^'i, 
j=k+i 

> (1 - - 39 i>k d 

> r'd. 

Taking B, = Bj^ in Lemma 15.121 we find Q[ k C B,^ for i = 1,2 such that the family 
{cr(Ffc)c : c G C- fe } is ^-disjoint and rj—covers {1, . . . , d} for i = 1, 2 and there is a bijection 
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if k : & lk -> Q' 2k with \{s G F k : a s (c) G 0i,<7,(¥>*(c)) G 2 }| > drl^fel for all c G 6'^. Then 
for each i = 1,2, the sets cr(Ffc)S^ k , . . . , a(Fg)Q' i e are pairwise disjoint, the family [Jj =k {a(Fj)c : 
c G C- •} is rj-disjomt, and 



U < F j)^ 

j=k 



W{F k )Q' hk \ + 



U ^ F ^ 

j=k+l 



I -J 



> ri—d + (£- k)ri—d = (£ - k + l)n— d, 
~ '16 16 v ; 'l6 



completing the recursive construction. 

When d is large enough, take a subset Ci^ of k for each 1 < k < t such that 



1 



24 



-d < 



U 



l,k 



k=l 



< 



1 



24 



r' 1 



24 



-d + 77(1 — rj)d. 



Set C2,fc = ¥>fc(Si,fc) for each 1 < k < t. Since the families U£ =1 {o"(i 7 fc)c : c G Ci,k} for « 
are 77-disjoint, we have 



1,2 



and 



U °( F k)£2,, 
k=l 



>(i-v) 



U ^fc)ei,* 
fc=i 



>(i 



U ^) C 2„ 
fc=l 



< 



U ^CWi,* 
fc=i 



< 



1 — 7] 



\ 1 1 



24 



+ 77 K 



□ 



We are ready to prove Theorem 15.81 

Proof of Theorem \5.8l It suffices to show that for any internal sets Y = fj« V n and Z = ITg Z n 
with strictly positive measure, there is some s G G' with n sY) > 0. In turn it is enough 
to show that there is some A > such that for every finite subset F of G and e > the set of 
all n G N for which there is some (p G Sym(d n ) satisfying pna,ram(^po- s , a s (p) < e for all s G F and 
|y( ^ )nZ " 1 > A belongs to ff. 



Set r = min(/x(r),/x(Z))/2, r' = § + and A = ^g/ . Take < ri < 1/2 to be a 

small number with r/jg < ^j-, to be determined in a moment. Then the set V of all n G N 
satisfying min(| ^ n J /c?7j, , l^^l/d^) ^ t belongs to Let £ and // be as in Lemma 15.131 We may 



assume that r/' < e/2. Set 9 



1-t' 



(l-ri) 2 24 1-n 



+ t-^ — \-rj' . Let k, and rj" be as in Lemma l5.9l Take 



F[ C C • • • C Fg, C F% C F2 C • • • C Fi to be finite subsets of G containing e such that 

(1) HiF^Fk) \ F k \ < r)\F k \ for all k = 1,. . . 

(2) < for all & = 2, . . . ,£' and |F£| > (l-r,)\F' k \ for all fc = 1, 
where F' k = {s G F' k : Fs C F0, and 

(3) KFfel 1 !^) \ F fc | < |F fc | for all k = 2,...,£ and \F k \ > (1 - t?)^] for all fe = 1, 
where F fc = {s G F fc : Fs C F k }. 



£' 
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Then we have Ai,...,A^ as in Lemma 15.91 When n G V is large enough, one has |23| > 
(1 — min(r/, rj"))d n where !B denotes the set of all a G {1, ... , <i n } satisfying 

c n) <rf(a) = cr njS a nt t(a), a n ,s( a ) ^ fT njS /(a), cr nie (a) 

for all s,i 6 (F LI F e ) LI (F LI Fg)^ 1 and distinct s, s' e F e LI Ff 1 , and one has S^i, . . . , C £ 
for i = 1,2 as in Lemma T5.13I for d = d n , a = a n , 3i = ^n, and 2i = % n . 

Let % G {1,2}. Set V< = {c G B : a n {F' e )c f\ \}i =1 a n {F k )Q hk = 0}. Then C 
U|=i o"n((^) _1 -Pfe)Ci,A;- Since the family \Jk=iWn(F k )c : c G is ^-disjoint, one has 



< 



+ 



|B\V t |< (J <Jn{(F' e )- l F k )^ k 

k=l 

I 

fc=l 

t 

<J2Wn(({F^)- 1 F k )\F k )e i>k \ + 
k=l 

<j2\m,)- 1 F k )\F k \.\e hk \ + 



fc=l 



U ^nCWi,/ 

fc=l 

[J &n(F k )Gi tk 
'c=l 

U 



k=l 



<r ? ^|F fe |-|e i)fe | + 



< 



< 



k=l 

J] 



U cr n (F fc )e iife 



fe=l 



+ 1 



1 — 77 

1 I — 



[J &n{F k )Qi^ k 
k=l 



d„ 



V 



(1 - 7/) 2 24 " 1-7? 



"dm 



and thus 



|v i | = |a3|-|s\v i |>(i-0)d n . 

Take <5 > with 2r/5 + 2t/<5£' + 2<5£' < rj. Taking V = Vj in Lemma 15.91 when n G V is large 
enough, we find 1; . . . , C^, C Vj such that 

(1) for every = 1, . . . ,£' and c 6 £■ t , the map s h-> <7 n ,s(c) from to a n {F' k )c is bijective, 

(2) the sets <r n (F{)C^ 1; . . . , a n (F^,)Q' i e , are pairwise disjoint and the family \J k=1 {a n (F k )c : 
c £ Q' ik } is //-disjoint and (1 — 9 — r/)-covers {1, . . . , d}, 

(3) Yi=x\W{F^ k \/d n -\ k \<8. 
Note that 



k=l 



< 



1 



dr. 



U ^(^) e i, fc 

fe=l 



+ 5 < 1 + 5. 



For each 1 < k < I', take C Q' l k and 6^ C Q' 2 k with 

le^Hie^Hminde^ue^i 
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Take a bijection (p' k : Q'{ k ->■ k . We have 

|ei,*l • \H\ - lebl • \H\ < j^MKKtl - K(4K k \ 

<(l + 2 V )\a n (F^e' hk \-\a n (F^e' 2;k \ 
< (1 + 2r/)(X k + 5)d n - (A fc - 8)d n 
= ( y 2r ] X k + 2r ] 5 + 25)d n , 

and similarly |e' 2jfe | ■ |i^| - |e' l fc | • \F' k \ < (2r]\ k + 2r]5 + 25)d n . Thus for each i = 1, 2 one has 

knO^K^U \ e i'fc)l < l e U \ e i'fel • \ F k\ 

= \Kk\ ■ \K\ - K k \ ■ WW < (2 v X k + 2r)6 + 2S)d n , 



and hence 



[j a n {Fl)Kk\ Q U 
k=i 



= EK(^)(eU\e^)| 
fc=i 

< ^(2r,A fc + 2r,5 + 2<5)d n 
fc=i 

< (2r,(l + <5) + 2/7(5/ + 2<5/)d n < 3r?d n . 



Therefore 



U °n{F' k )Ql 

k=l 



> 



U ^(^)^„ 



k=l 



fc=l 



> (1 - e - ri)d n - 3rid n = (1-9- 4r))d n 

for i = 1,2. 

Since the families Ufc=i{°Vi(-^fc) c 1 c e C«,fc} f° r i = 1, 2 are 77-disjoint, we can find Fj ;C C 
with |Fj jC | > (1 — i])\Fk\ for all i = 1, 2, A; = 1, . . . , £, and c G so that for each i = 1,2, 
the sets a n (Fi yC )c for c G |j|=i ^i,k are pairwise disjoint. For every k = !,...,£ and c G Ci,fe, 
set F c = F hc n F 2)Vfc(c) and F c = {s e F c : Fs C F c }. Then |F C | > (1 - 2 V )\F k \ and |F C | > 
|F fc | - 2 V \F\ ■ \F k \ > (1 - (2|F| + l)v)\F k \. 

Similarly, for every 1 < k < £' and c G 6^, we find some C F£ with |F C '| > (1 - 2j])\F' k \ 

such that the sets a n (F' c )c for c G Ufc=i ^'l fc> as we ^ as se * s a n{F' c ) i p' k {c) for c G Ufe=i ^i fc> 
are pairwise disjoint. Setting F' c = {s G F' c : Fs C F c '}, we have |F C '| > (1 - (2|F| + l)r/)|i^|. 
Note that 



U U °n{F c )c 

k=icee 1>k 



= E £ l^l 

fc=i ceei ifc 

>EE (1- (21^1 + 1)^)1^1 

fc=l cGd fc 



> (1 - (2|F| + 1)7,) 



U ^1.(^)61,* 

k=l 
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>(l- (2^1 + 1)^(1-7?)^^. 



Similarly, 



U U °n{F' c )c 

k=icee'l k 



> (i _ ( 2 |F| + l)r,) 



U °n(KKk 



k=l 



> (l-(2\F\ + l)ri)(l-e-4r))d n . 
Set W = ( U| =1 U ce e M ^(F c )c) U ( Ui' = i U ce e» fc ^n(^)c). Then 



1-r' 



|W| > (l - (2|F| + 1)7?)(1 - r/)— — d n + (l - (2|F| + 1)7?)(1 - - 4r,K. 



24 

Take a ip G Sym(d n ) such that <^(cr n)S (c)) = cr niS (<^jfc(c)) for all k = 1, ...,£, c G Si,fc, and 
s G F c , and <^((T„ )S (c)) = c n)S (^(c)) for all k = 1, ...,£', c G S'/ fc , and s G F c '. For every s £ F, 
note that cr n)S <£> = ¥>Cn,s on W, and hence 

|W| 

PHamm (o"n,s^, V 30 "^) < 1 ~ 



<l-(l-(2|F| + 1)7?)(1- 7?) 



1-/ 

24 



(l-(2|F| + 1)t/) (1-0-47?) <e 



when 7? is small enough. We also have 



|^(^n) n Z n \ > \i s G : cr„, s (c) G y„,cr niS (^fc(c)) G & n }| 

k=\ cgei jfe 

(<^(c)) G Z„}| -27/|F fc | 

fc=i ceei jfe 
« / / _\ 2 



2 £■£((*) 



>y y T —\F k \ > — 

~ rl « 8 1 fel ~ 8 



U Cn(-Pifc)Cl,fc 



fc=l 



1 - r' , r 2 1 - r' 
-an > 



24 



16 24 



d n — \d n 



when 7? is small enough. 



□ 



Question 5.14. Does every countable sofic group G admit a sofic approximation sequence £ 
such that the action of G' on (]1#{1> ■ ■ ■ > ^»}> ®> A 4 ) ^ s ergodic? 

6. IE-TUPLES AND ALGEBRAIC ACTIONS 

By an algebraic action we mean an action of a countable discrete group G on a compact 
metrizable Abelian group X by (continuous) automorphisms. The structure of such an action 
is captured by the Pontryagin dual X viewed as a module over the integral group ring 7LG. 
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The ring ZG consists of the finitely supported Z-valued functions on G, which we write in the 
form J^secfss, with addition (J2seG fss) + (EseG 9ss) = J^secifs + 9s)s and multiplication 
(EseG fss)(J2seG9 s s) = J2seG(J2teG ftg t -i s ) s - 

Given a matrix A in M n (ZG), the left action of G on (ZG)™/(ZG) n A gives rise via Pontryagin 

duality to the algebraic action G r\ X A := (ZG) n /(ZG) n A. Write A* for the matrix in M n (ZG) 
whose entry is the result of applying the involution (EseG fa 3 )* = EseG fsS" 1 to the (j, i) 
entry of A. Viewing (ZG) n as ((M./1i) G ) n , we can then identify Xa with the closed G-invariant 
subset 

{xG((R/Z) G T:xA* = O mmG)n } 

of ((R/Z) G ) n equipped with the action of G by left translation. In the case that A is invertible 
in M n (l l (G)) the action G r> is expansive, and in fact such actions and their restrictions to 
closed G-invariant subgroups constitute precisely all of the expansive algebraic actions [1, Thm. 
3.1]. When G is amenable, given an action of the form G r\ Xa with A invertible in M n (| 1 (G)), 
every tuple of points in X is an IE-tuple (see Lemma 5.4 and Theorems 7.3 and 7.8 in [8|]). We 
will extend this result in two ways in Theorems 16.61 and 16. 7\ which demonstrate that in broader 
contexts independent behaviour similarly saturates the structure of actions of the form G rx Xa 
with A invertible in M n (i 1 (G)). 

First however we examine orbit IE-tuples in the context of actions G r\ X on a compact 
metrizable (not necessarily Abelian) group by automorphisms. It was shown in 0, Theorem 7.3] 
that, when G is amenable, the IE-tuples for such an action are determined by a closed G-invariant 
normal subgroup of X called the IE group. We now proceed to record some observations showing 
that the basic theory of the IE-group from [8)] can be extended from amenable G to general G 
using orbit IE-tuples. Thus G will be an arbitrary countable discrete group until we turn to the 
sofic setting in Theorem 16.71 

The proof of Lemma 3.11 in [23] shows the following: 

Lemma 6.1. let G act continuously on a compact metrizable space X. Let A be a Borel subset 
of X, and [i a G-invariant Borel probability measure on X. Then A has independence density 
at least n{A) over G. 

From Lemma 16. II we immediately obtain: 

Lemma 6.2. Let G act continuously on a compact metrizable space X. Let n be a G-invariant 
Borel probability measure on X. Then every point in the support of fi is an orbit IE-1-tuple. 

We now suppose that G acts continuously on a compact metrizable group X by automor- 
phisms. From Lemma 16.21 we have: 

Lemma 6.3. Every point of X is an orbit IE-1-tuple. 

Denote by LE(X) the set of all x G X such that (x,ex) is an orbit IE-pair, where ex is the 
identity element of X. The proof of Theorem 7.3 in [8J shows the following. 

Theorem 6.4. IE(X) is a closed G-invariant normal subgroup of X. For every k G N the set 
IEfc(X, G) of all orbit IE-k-tuples is a closed G-invariant subgroup of the group X k and 

lE k {X, G) = {{x iy , x k y) :x 1 ,...,x k € JE(X), y G X} 

= {(yxi, . . . ,yx k ) :xi,...,x k e IE(X), y G X}. 
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Now we suppose that X is Abelian. In this case a point x G X is said to be 1-homoclinic if 
the function s \-¥ tp(sx) — 1 on G lies in for every 99 in the Pontryagin dual X. The set of 

1-homoclinic points is written A 1 (X). This set was studied in [3lL 132. |38 | in the case G = Z d 
and in 0] for more general G. From the proof of Theorem 7.8 injaj we obtain the following. 

Theorem 6.5. Suppose that X is a finitely generated left TLG-module. Then A 1 (X) C IE(X). 

From Theorem 16.51 and [8j, Lemma 5.4] we obtain: 

Theorem 6.6. Let n G N, and let A be an element ofM n (ZG) which is invertible in M n (l (G)). 
Then for the action G rx Xa one has IE(Xa) = Xa- 

Now we let G be a countable sofic group and S = {<7j : G —> Sym(di)}^ 1 a sofic approximation 
sequence for G. 

Theorem 6.7. Let n G N, and let A be an element of M n {7LG) which is invertible in M n (l l (G)). 
Consider the action G rx Xa- Then, for each k G N, every k-tuple of points in Xa is a S-IE- 
tuple. 

Before proceeding to the proof of Theorem 16. 7\ we give an application to a problem of 
Deninger. For an invertible element / in the group von Neumann algebra LG of a count- 
able discrete group G the Fuglede-Kadison determinant is defined by det^c f = exptr(log |/|) 
where tr is the canonical trace on LG. In [10, Question 26] Deninger asked whether det^c f > 1 
whenever / G TLG is invertible in and has no left inverse in %G. An affirmative answer 

was given by Deninger and Schmidt in the case that G is residually finite and amenable [11, 
Cor. 6.7] and more generally by Chung and the second author in the case G is amenable [8j, 
Corollary 7.9]. Using Theorem 16.71 Proposition 14. 16T 3) . Theorem 7.1 in [25J, and the argument 
in the proof of Corollary 7.9 in [8(, we obtain an answer to Deninger's question for all countable 
residually finite groups: 

Corollary 6.8. Suppose that G is residually finite and that f is an element of T,G which is 
invertible in l l (G) and has no left inverse in TLG. Then det^c f > 1- 

Let n G N. For A = (^j)l<i,i<n e M n {i 1 (G)), we set 

Nli= E IKHi- 

l<i,j<n 

For (ai, . . . , a n ) G M. d , we set ||(ai, . . . , a n )||oo = maxi<j< n \dj\. For ^ : {1, . . . , d} — > 76 n , we set 

Moo = max U(Moo. 

±<]<d 

Denote by P the natural quotient map (M n ) G — > ((M/Z) n ) G '. Denote by p the canonical metric 
on R/Z defined by 

p(t\ + Z, to + Z) := min \ t\ — to — ml . 

By abuse of notation, we also use p to denote the metric on (R/Z) n defined by 

p((ai,...,a n ),(bi,...,b n )) := max p(a,j,bj). 

l<j<n 

Via the coordinate map at the identity element of G, we will think of p as a continuous pseudo- 
metric on ((M/Z) n ) G . 
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Lemma 6.9. Let n £ N, and let A be an element of M n {/LG) which is invertible in M n {i l {G)). 
Consider the action G r\ Xa- Let F be a nonempty finite subset of G and let M,6 > 0. For 
every d G N, good enough sofic approximation a : G — > Sym(d), and £ : {1, . . . , d} — > Z n with 
U\\oo < M, if we define h : {1, . . . , d} (Z n ) G and p : {1, . . . , d} -»■ X A by 

{h{a)) t -i = £{ta) for all t £ G 

and 

<p(a) = Pdhia^A*)- 1 ) 

then tp £ Map(p, F, 5, a) . 

Proof. Since (^4*) _1 G Md(l l {G)), there exists a nonempty finite subset K of G such that for all 
z\,z 2 G (Z ra ) G such that ||^i||oo, Halloo < M and zi,z% coincide on K, one has ||(zi( J 4*) _1 ) e — 
(z 2 {A*)- 1 ) e \\ OD < 5/2, which implies that p(P(z 1 (^*)- 1 ), P^A*)- 1 )) < 5/2. 

Denote by A the set of all a G {1, . . . , d} satisfying t(sa) = (ts)a for all t G K" 1 and s G F. 
When a is a good enough sofic approximation for G, one has |A| > (1 — (5/2) 2 )d. Let a G A and 
s G -F. Then 

S Ma)) = P(( S (l 1 (a)))(#)- 1 ) 

and 

V3 M = P((/ i ( S a))(^)- 1 ). 

For every t £ K^ 1 one has 

(s(/i(a))) t -i = (h(a)) s - H -i = £((ts)a) = t(t(sa)) = (h(sa)) t -i. 

Thus, by the choice of K, we have p(s(tp(a)), tp(sa)) < 5/2. Note that ((R/Z) n ) G has diameter 
1 under p. It follows that 

P2(sp(-), (p(s-)) < ((5/2) 2 + 1 - \A\/d) 1/2 < 5. 

Therefore ip G Map(p, F, 5, a). □ 

We are ready to prove Theorem 16.71 

Proof of Theorem \6. 7\ Denote by A(Xa) the set of homoclinic points in Xa, i.e., the points 
x G Xa such that sx converges to the identity element as G 3 s — > oo. By [ill, Thm. 4.6] (see 
also [a, Lemma 5.4 and Prop. 5.2]), A(Xa) is dense in Xa- By Proposition 14. 16T 4) it suffices to 
show that every A;-tuple of points in A(Xa) is a S-IE-tuple. 

Let x = (x±, . . . ,Xk) be a /c-tuple of points in A(Xa)- Then for each 1 < j < k there is a 
Zj G (Z n ) G such that ||^-||oo < Pill and xj = PizjiA*)- 1 ). 

Let U\ x • • • x Uk be a product neighborhood of x in X k . Since the map from bounded subsets 
of (Z n ) G e quip ped with the pointwise convergence topology to Xa sending z to P(z(A*)^ 1 ) is 
continuous [111 . Prop. 4.2], there is a nonempty finite subset K of G such that for every 1 < j < k 
and z G (7L n ) G with \\z\\oo < \\A\\i and z\ K = zj\ K , one has P(z(A*y 1 ) G Uj. 

Let F be a nonempty finite subset of G and 5 > 0. Let (f G N and let a be a map from G to 
Sym(<i). Denote by A the set of all a G {1, . . . , d} such that sa ^ ta for all distinct s, t G K~ l . 
When a is a good enough sofic approximation for G, we have |A| > d/2. Let 3 be a maximal 
subset of A subject to the condition that the sets K~ l a for a £ 3 are pairwise disjoint. Then 
A C ( ( j(^- 1 ))-V(A— 1 )a, and hence |A| < |AT| 2 |3|. Therefore |g| > d/(2|AT| 2 ). 

We claim that 3 is a (/>, F, 5, <j)-independence set for U = (Ui, . . . , Ui~) when a is a good 
enough sofic approximation for G. Let w be a map from {1, ... ,d} to {1, ... , k). Define £ : 
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{1, . . . , d} — > 7L n by £(ta) = (z^ a \) t -i for all a G 3 and t G K" 1 , and £(&) = for all b not in 
K^ 1 ^. Then we have h : {1, . . . , d} — > (1, n ) G and 92 G Map(p, i 7 , 5, a) defined in Lemma 16.91 for 
M = \\A\\\ when a is a good enough sofic approximation. Let a £ 3. For any t £ K' 1 , one has 

(h(a)) t -i = £(ta) = {z^ a) ) t -i. 

By the choice of K we have 97(a) = P(/i(a)(^4*) _1 ) € U w ( a y This proves our claim, and finishes 
the proof of the theorem. □ 

7. Orbit IE-tuples and untameness 

Let G be a countably infinite group acting continuously on a compact Hausdorff space X. 

Theorem 7.1. -Let t£N and /ei A be a k-tuple of subsets of X. Suppose that A has positive 
independence density over G. Then A has an infinite independence set in G. 

Proof. Denote by q the density of A over G. 

Let F\ be a nonempty finite subset of G. Take si,S2, ... in G such that setting F n +i = 
F n U F n s n for all n G N one has F n n F„s n = for all n G N. 

Let n G N. Take an independence set £7 n of A contained in F n with \E n \ > q\F n \. We will 

(n) (n) 

construct, inductively on m, nonempty finite subsets F^ i and Em of G for all 1 < m < A; < n 

(n) 

and tm G G for all 1 < m < n such that 

(1) F$ = F n and 4 n) = 

(2) is equal to either e or s" 1 for each 1 < m < n; 

(3) F S = Fmll^™ and = F ™ for all 1 < m < k < n; 

(4) E^ ] = E^t^ for each 1 < m < n; 

(5) \E { m ] n F^\\ > q\F%l\ for all 1 < m < k < n. 

To start with, we define F^fy and E^ according to (1). If \E^ H F n -i\ > g|F n _i|, we set 
t^Zj = e. Otherwise, since n F^n\ > q\F^n\ and F^n = F n is the disjoint union of 

F n _i and F n _is n _i, we must have |i?4 n F n _is n _i| > q\F n -is n -i\, and we set t^l x = 
Defining F^ 1 . for n — 1 < k < n and i^-i according to (3) and (4) respectively, we have 
that (5) holds for m = n — 1. Next, if \E%\ n F n _ 2 | > l\E n -2\, we set = e. Otherwise, 
since H ^n-in-ll — 1 n-ll ano - ^n-i n-1 = is the disjoint union of F n _2 and 

F n -2S n -2, we must have l-E^ii D F n _2S n _2| > <2i-Fn-2Sn-2|, and we set = s n-2- Defining 
fcforn — 2 < k < n and according to (3) and (4) respectively, we have that (5) 

holds for m = n — 2. Continuing in this way, we define F^\, Em\ and t^m satisfying the above 
conditions. 

Note that if E' is an independence set for A in G, then E's is an independence set for A in 
G for all s G G. By induction on m, we find easily that E^ is an independence set for A in 

(n) 

G for all n G N and 1 < m < n. Also note that for any 1 < m < k < n, Fi^ i depends only on 

fn) (n) 
F^CiE^ . In particular, for any fixed k G N the number of sets appearing in F} . for all n > k is 

finite. Thus we can find a strictly increasing sequence ri\ < n2 < ■ ■ ■ in N such that for any fixed 
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k G N the sets F$ and E^ n do not depend on I > k. Set E = [j km (E[ nk) n F[ nk) ). 

Since \E[ nk) n F^ 
evey one has 



Since |^ nfc) n F^] > glF^I = g|F fc | = g|Fi|2 fe_1 for every kN, the set F is infinite. For 



(E[ nk+l) n f^ ) n Fftt = (E[ nk+l) n F^) n F x ( J fc+l) 

= jE K) nj p(n fc ), 

Thus the sequence {E[ nk ^ n F^^jfceN is increasing. Since the family of independence sets for 
A in G is closed under taking increasing unions, we conclude that E is an independence set for 
A in G. □ 

Recall that that a tuple (x±, . . . , Xk) G is an IT-tuple if for every product neighbourhood 
U± X • • • X Uf. of (xi, . . . , Xfe) the tuple (Z7l, . . . , C/fc) has an infinite independence set [23| . 

Corollary 7.2. Every orbit IE-tuple of the action G r\ X is an IT-tuple. 

Write C(X) for the Banach space of continuous complex- valued functions on X with the 
supremum norm. The action G rx X is said to be tame if no element / G C(X) admits an 
infinite subset J of G such that, for s ranging in J, the family of functions x i— )■ f(s~ 1 x) in C(X) 
is equivalent to the standard basis of £ , meaning that there is a bijection between the two 
which extends to an isomorphism (i.e., a bounded linear map with bounded inverse) between 
the closures of their linear spans [l5|, HtJ ■ The action is tame if and only if there is no nondiagonal 
IT-pair in X x X [23, Prop. 6.4]. Thus from the above corollary we see that a tame action has 
no nondiagonal orbit IE-tuples. 



8. S-IE-TUPLES AND Ll-YORKE CHAOS 

Let G be a countably infinite sofic group and S = {cij : G —> Sym(dj)}^ 1 a sofic approximation 
sequence for G. We fix a free ultrafilter J on N and use it in the definitions of sofic topological 
entropy and S-IE-tuples, as in Section [5j 

Let G r\ X be a continuous action on a compact metrizable space. Let p be a compatible 
metric on X. We say that (i,i/)£lxlisa Li-Yorke pair if 

lim sup p(sx, sy) > and liminf p(sx,sy) = 0. 

where the limit supremum and limit infimum mean the limits of sup S&G \ F p(sx, sy) and 
inf sGG \^ p(sx, sy), respectively, over the net of finite subsets F of G. Note that the defini- 
tion of Li-Yorke pair does not depend on the choice of the metric p. We say that the action 
G rx X is Li- Yorke chaotic if there is an uncountable subset Z of X such that every nondiagonal 
pair (x, y) in Z x Z is a Li-Yorke pair. These definitions adapt those for continuous N-actions, 
which have their origins in [3(3]. In that settingBlanchard, Glasner, Kolyada, and Maass showed 
that positive entropy implies Li-Yorke chaos [3J. The following theorem demonstrates that, in 
our sofic context, positive topological entropy with respect to some sofic approximation sequence 
implies Li-Yorke chaos (cf. [23l . Thm. 3.18]). 
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Theorem 8.1. Suppose that k > 2 and x = (x\, . . . , Xf.) is a T^-IE-tuple in X k with x\, . . . , x^ 
pairwise distinct. For each 1 < j < k, let Aj be a neighbourhood of Xj. Then there exist Cantor 
sets Zj C Aj for j = 1, . . . , k such that the following hold: 

(1) every nonempty finite tuple of points in Z := [jj Zj is a H-IE-tuple; 

(2) for all m G N, distinct y±, . . . , y m G Z, and y[, . . . ,y' m G Z one has 

liminf max p(syi,y i ) = 0. 

G^s— >oo l<i<m 

We now set out to prove Theorem 18. 11 We begin with the following lemmas. 

Lemma 8.2. Let k > 2 and A = (Ai, . . . ,Ak) be a tuple of closed subsets of X with positive 
upper independence density over E. For each j = 1, . . . , k let Uj be an open set containing Aj. 
Let E be a finite subset of G. Then there exists an s £ G \ E such that the tuple A' consisting 
of Ai n s~ l Uj for all i,j = 1, . . . ,k has positive upper independence density over S. 

Proof. Take 1 < A < Then we have the constant c > in Lemma 14.51 Take a q > such 
that for every nonempty finite subset F of G and 5 > the set Vp^ of alH G N for which A has a 
(p, F, S, aj )-independence set of cardinality at least qdi is in 5- Take a finite subset W of G such 
that cq\W\ > 8 and for any distinct s,t G W one has s~ 1 t g" E. When < |VF| 2 k < 1/2, the 

number of subsets of {1, . . . ,d} of cardinality no greater than iVKpKcf is equal to 2~^}S)' (j)> 
which is at most |W^| 2K ^(|jy|2 K(i ) , which by Stirling's approximation is less than exp(/3d) for some 
j3 > depending on k but not on d when d is sufficiently large with f3 — > as k — > 0. Take 
c(7/(2|iy| 2 ) > k > such that for any 1 < j < k and x G X \ Uj one has p(x,Aj) > yJ~K and 
for all sufficiently large d G N the number of subsets of {1, . . . , d} of cardinality no greater than 

|Vl^| 2 K(i is at most ( (k-i)\ ) • 

Let F be a nonempty finite subset of G and 5 > 0. Set F' = F U W and 5' = min(<5, k). Let 
i G N be such that A has a (p, F' , 5', ai )-independence set di of cardinality at least qdi. For 
each oj G {1, . . . , k} 3i take a tp u G Map(p, F' , 5', cr^) such that (p w {a) G A u i a \ for every a G di- 
For each oj G {1, . . . ,k} 3i , there is some A w C {1, . . . with |A W | > (1 — |VF| 2 <5')<ii such that 
p{ ( Ptj(o'i(s)a), s(p U} (a)) < Vfr for all s G W~ 1 W and a G A w . By the choice of k, when i is large 
enough there is a subset 0^ of {1, . . . , k} 3i with ( ( k \^x ) 9 — sucn t na ^ the set A w is 
the same, say 0j, for every oj G Qi, and > 1 — |VF| 2 <5' > 1 — cq/2. Then 

> > k«4^\" = ((* - ,)A)W. 



By our choice of c, we can find a subset ^ of 3i with |#^| > c\3i\ > cqdi such that every map 
3'i — > {1, • • • , k} extends to some w G fij. When i is large enough, one also has |Wj| > (l — cq/A)di 
for the set 

Wi = {a G {1, . . . , di} : ((a i (s))- 1 a i (t))(a) = cr i (s~ 1 t)(a) for all s, t G W 

and (7j(s)(a) / a for all s G W^Vfe}}. 

Note that |Wj n 6j n 3'i\ > cqdi/ 4 and every map Wj n 0j fl 3 • — >■ {1, . . . , k} extends to some 
u G O,;. 
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Denote by rj the maximum of |<7j(s)(Wj n 0; fl^) H <7j(t)(W; n 9j n d'i)\/di for s,t ranging over 
distinct elements of W. Then for each s G W there is a subset Tj jS of <7i(s)(Wi n Oj n 3-) with 
cardinality at most 77 1 VI/" | cZ^ such that the sets (<7j(s)(1Vj n 9j D 3-)) \ Tj jS for sGlf are pairwise 
disjoint. It follows that 



k< WCW< n e< n a-)| < + 



(J (^(^(w.ne.nglT^ 

seW 



< 7]\W\ 2 di + di. 

On the other hand, we have 

Wi(s)(Wi n a* n aDl = |W| • |w< n e< n a-| > |^|c^/4 > 2*. 

sew 

Thus 7? > 1/1 W| 2 . Then we can find some distinct G with |cr i (t i )(Wj D 9j n 3-) n 
fTi(t-)(Wi n Gi n > di/\W\ 2 . Set ^ = tr 1 ^. Then Si G W" 1 !^ \ {e}, and 

|(w< n 6i n 3'i) n (a i ( Si ))" 1 (w i n e< n #)l 

= |(Wi n 6i n n ^( Si )(Wi n e< n a-)| 
= \*i(u)0Vi n 6i n a-) n ^(w^ n 9; n a-)l 
><V|W| 2 . 

Take a maximal subset S, of (Wjn9jnaO n (^( s i)) _1 ('Wi'~ | 0j'~ l #i) subject to the condition that 
for any a G Hj, neither o"j(sj)(a) nor (<7j(sj)) _1 (a) is in E». Then S, U crj(sj)Sj U (crj(sj)) _1 Hj D 

(w i nG i naDn( C j i ( s ,))- 1 (w i nG i naD. it follows that > KWin^na'Jn faC*))" 1 ^ n 

9j n 301/3 > di/(3|iy| 2 ). Note that Hi and cr;(sj)S; are disjoint subsets of W; n 9j n 

Let £ = : Si ->■ {!,-•• ,^} 2 - Define a map £' : Hj U £jj(sj)Hj -> {l,...,fc} by 

£'( a ) = £i( a ) an£ i C'(°'i( s i)( a )) = £2(0) for all a G H». Extend £' to some w G Then 
</? w G Map(p, F, S, o"j), ^(a) G A w(a) = Aft (a) and <£ w (cr;(s;)(a)) G A w((J .( s .)( a )) = % (a) for all 

a G Si. For any a G Sj, since p(ip UJ (ai(si)a), Siip Ld (a)) < y/S' < a/k, by the choice of k we 
have Si<p u (a) G C^ a ( a )i an d hence (#j(a) G -4^ ( a ) H ^ft(a)- Therefore Hj is a (p, F,5,o~i)- 
independence set of cardinality at least <ij/(3|W^| 2 ) for the tuple consisting of A\ n s^ 1 Uj for all 
Z,j = l,...,fc. 

There is some sp,s G W~ X W \ {e} such that the set of i G Vp/^/ for which s» is defined and 
Si = sf,s lies in 5- It follows that we can find an s G W~ 1 W \{e} such that for any nonempty 
finite subset F of G and (5 > there are some nonempty finite subset F of G and 5 > with 
F C F and 5 > S such that = s. Then the tuple A' consisting of A\ n s~ x Uj for all 

I, j = 1, . . . , k has upper independence density at least 1/ (3| W| 2 ) over S. From the choice of W 
we have s tfL E. □ 

From Lemma 18.21 by induction on m we have: 

Lemma 8.3. Let k > 2 and A = (A\, . . . ,A}-) be a tuple of closed subsets of X with positive 
upper independence density over S. For each j = 1, . . . , k let Uj be an open set containing Aj. 
Let E be a finite subset of G and m G N. Then there exist s\, . . . , s m G G\E such that s~ 1 Sj g" E 
for all distinct 1 < i,j < m and the tuple A' consisting of Ai n s^f 1 f/ w (i) n • • • Pi s^U^im) for all 
1 < i < k and ui G {!,..., k] m has positive upper independence density over S. 
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We are ready to prove Theorem 18.11 

Proof of Theorem \8.1[ We may assume that the Aj are closed and pairwise disjoint. Take an 
increasing sequence E± C E2 Q . . . of finite subsets of G with union G. We shall construct, 
via induction on m, closed nonempty subsets A m j of X for 1 < j < A; 2 ™ with the following 
properties: 

(a) A\j = Aj for all 1 < j < k, 

(b) for every m > 2 and 1 < i < A; 2 '™ , A m -n contains exactly A; 2 ™ 2 of the A m j for 

1 - J - fc2m " 1 ' m -i 

(c) for every m > 2 and map 7 : {1,...,A; 2 } — > {l,...,k 2 } there exists a t 7 £ 

G \ -Em-i such that t^A m j C [/ m _ 1)7 (j) for all 1 < j < A; 2 ™ , where f7 m -i,i = {1 £ I : 

< 2" m 5 m _i} for all 1 < i < A; 2 ™ and <5 m _i = min/3(x,y) for cc,y ranging 
over points in distinct A m -ij, 



-ym— 1 



(d) when m > 2, diam(A mJ ) < 2" m for all 1 < j < A; 2 " . 

(e) for every m, the sets A m j for 1 < j < k 2 ™ 1 are pairwise disjoint, 

(f) for every m, the collection {A m j : 1 < j < k 2 ™ }, ordered into a tuple, has positive 
upper independence density over E. 

Suppose that we have constructed such A m j over all m. Properties (b), (d) and (e) imply that 

Z = HmeN Uj=i ^mj is a Cantor set. Property (a) implies that Zj := Z n Aj is also a Cantor 
set for each 1 < j < k. Condition (1) follows from properties (d) and (f). Condition (2) follows 
from properties (c) and (d). 

We now construct the A m j. Define A\ 4 for 1 < j < k according to property (a). By 
assumption properties (e) and (f) are satisfied for m = 1. Assume that we have constructed A m j 

for all j = 1, . . . , k 2 " 1 1 with the above properties. Set n = l + (k 2m 1 ) k ' 2 . By Lemma f8.3l we can 
find s±, . . . , s n E G\E m such that the tuple consisting of A m ^ n Si l U m ^(i) H • • • n s^U^^/^ for 
all 1 < i < k 2 ™ 1 and u £ {1, . . . , A: 2 ™ 1 } n has positive upper independence density over S. Take 
a bijection <p : {1, . . . , /j 2 " 1-1 }! 1 . - ^ 2 > {2, . . . , n}. For each 7 : {1, . . . , A; 2 ™} -)■ {1, . . . , A; 2 ™ -1 }, 
set i 7 = s v ( 7 y For all 1 < i,j < k 2 , define G {1, . . . , A; 2 } n by Wjj(l) = j and 

Wi,i(<^(7)) = 7((»- l)*; 2 " 1 " 1 +j) for all 7 £ {1, • • . , A: 2 "^ 1 }^-^ 2 " 1 }, and set ^ m+li(i _ 1)fe2 — i +j = 

,a)ij(n)- Then properties (b), (c), (e) and (f) hold for m + 1. For 
each 1 < j < A; 2 " 1 write A rn+ ij as the union of finitely many closed subsets each with diameter 
no bigger than 2~( m+1 ). Using Lemma 14.131 we may replace A m+ ij by one of these subsets. 
Consequently, property (d) is also satisfied for m + 1. This completes the induction procedure 
and hence the proof of the theorem. □ 

Corollary 8.4. If h^X^G) > for some sofic approximation sequence £ then the action is 
Li-Yorke chaotic. 
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